-- Logs begin at Thu 2022-05-19 11:17:16 UTC, end at Thu 2022-05-19 12:43:10 UTC. -- May 19 12:07:46.046699 dv-cinder-804757-28-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 19 12:07:46.057995 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 12:07:46.060081 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 12:07:46 2022] *** May 19 12:07:46.060081 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 12:07:46.060081 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 12:07:46.060081 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: nodename: dv-cinder-804757-28-iscsi May 19 12:07:46.060081 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: machine: x86_64 May 19 12:07:46.060081 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: clock source: unix May 19 12:07:46.060081 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: pcre jit disabled May 19 12:07:46.060081 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: detected number of CPU cores: 4 May 19 12:07:46.060081 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: current working directory: / May 19 12:07:46.060081 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: detected binary path: /usr/bin/uwsgi-core May 19 12:07:46.061154 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: your processes number limit is 47680 May 19 12:07:46.061154 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: your memory page size is 4096 bytes May 19 12:07:46.061154 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: detected max file descriptor number: 2048 May 19 12:07:46.061154 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: lock engine: pthread robust mutexes May 19 12:07:46.061154 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: thunder lock: enabled May 19 12:07:46.061154 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 12:07:46.061154 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 12:07:46.116069 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: Python main interpreter initialized at 0x55d8b00f89c0 May 19 12:07:46.116069 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: python threads support enabled May 19 12:07:46.116069 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: your server socket listen backlog is limited to 100 connections May 19 12:07:46.116069 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: your mercy for graceful operations on workers is 90 seconds May 19 12:07:46.116587 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: mapped 403077 bytes (393 KB) for 2 cores May 19 12:07:46.116587 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: *** Operational MODE: preforking *** May 19 12:07:46.116732 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: *** uWSGI is running in multiple interpreter mode *** May 19 12:07:46.116732 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: spawned uWSGI master process (pid: 103474) May 19 12:07:46.116939 dv-cinder-804757-28-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 19 12:07:46.118051 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: spawned uWSGI worker 1 (pid: 103475, cores: 1) May 19 12:07:46.118051 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: spawned uWSGI worker 2 (pid: 103476, cores: 1) May 19 12:07:46.118051 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 12:07:47.353072 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 12:07:47.546469 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 12:07:48.092235 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 12:07:48.092235 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: from cryptography.utils import int_from_bytes May 19 12:07:48.092550 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 12:07:48.092550 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: from cryptography.utils import int_from_bytes May 19 12:07:48.947451 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 12:07:48.947451 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: from cryptography.utils import int_from_bytes May 19 12:07:48.948089 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 12:07:48.948089 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: from cryptography.utils import int_from_bytes May 19 12:07:50.727942 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 12:07:50.728666 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 12:07:50.728761 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 12:07:50.729094 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 12:07:50.729351 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 12:07:50.729744 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.730069 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.730384 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.730704 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.731032 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.731344 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.731665 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.732022 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.732352 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.732609 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.732925 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.733247 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804757-28-iscsi {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.733568 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.733877 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.734192 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.734513 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.734829 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.735736 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.736220 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.736959 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.737393 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.737704 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.738019 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.738355 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.738674 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.738984 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.739303 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.739614 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.739967 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.740282 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.740686 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804757-28-iscsi {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.741037 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.741319 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.741635 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.742059 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.742374 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.742685 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.743265 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.743384 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.743627 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.743627 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.743627 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.743627 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.745211 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.745211 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.745998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.745998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.746143 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.746386 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.746696 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.746945 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.747249 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.747566 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.747912 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.748231 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.748485 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.748725 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.749046 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.749364 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.749669 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.749977 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.750281 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.750590 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.750951 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.751258 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.751565 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.752081 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.752405 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.752719 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.753044 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.753351 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.753670 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.754075 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.754329 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.754629 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.754977 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.755294 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.755605 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.755947 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.756268 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.756574 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.756879 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.757185 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.757495 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.757815 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.758118 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.758376 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.758673 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.758977 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.759295 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.759598 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.759938 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.760245 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.760543 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.760846 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.761150 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.761452 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.761758 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.762064 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.762366 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.762665 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.762974 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.763275 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.763588 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.763930 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.764243 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.764548 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.764850 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.765157 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.765469 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.765772 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.766075 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.766430 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.766882 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.767368 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.767691 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.768034 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.768344 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.768660 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.768959 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.769265 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.769582 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.769887 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.770191 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.770495 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.770796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.771096 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.771401 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.771696 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.772017 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.772316 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.772632 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.772951 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.773258 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.773562 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.773864 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.774178 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:50.774518 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.774848 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.775187 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.775502 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.775852 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.776185 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.776501 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.776816 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.777129 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.777453 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.777763 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.778072 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.778382 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.778699 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.779100 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.779347 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.779659 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.780003 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.780319 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.780624 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.780943 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.781271 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.781589 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.782409 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.782889 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.783290 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.783609 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.783959 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.784288 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.784600 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.784911 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.785225 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.785561 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.785893 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.786200 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.786523 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.786835 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.787145 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.787452 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.787765 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.788098 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.788436 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.788772 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.789060 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.789371 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.789686 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.789995 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.790306 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.790610 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.790909 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.791220 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.791522 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.791849 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.792157 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.792478 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.792805 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.793112 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.793446 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.793752 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.794060 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.794372 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.794679 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.794984 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.795293 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.795608 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.795932 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.796253 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.796574 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.796877 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.797198 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.797525 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.798349 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.798662 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.798972 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.799283 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.799593 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.799928 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.800246 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.800560 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.800877 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.801216 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.801547 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.801851 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.802172 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.802498 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.802811 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.803115 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.803423 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.803724 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.804052 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.804346 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.804648 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.804950 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.805253 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.805558 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.805887 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.806155 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.806471 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.806778 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.807081 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.807382 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.807686 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.808058 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.808364 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.808706 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.809037 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.809359 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.809680 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.809991 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.810305 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.810614 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.810923 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.811232 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.811539 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.811879 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.812197 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.812516 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.812853 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.813210 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.813628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.814066 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.814397 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.814696 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.815039 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.815379 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.815698 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.816045 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.816360 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.816679 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.816989 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.817302 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.817613 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.817923 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.818243 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.818553 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.818873 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.819175 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.819504 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.819833 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.820154 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.820464 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.820782 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.821112 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.821447 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.821758 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.822073 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.822394 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.822709 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.823021 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.823333 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.823642 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.823966 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.824282 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.824597 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.824909 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.825222 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.825525 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.825840 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.826151 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.826456 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.826758 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.827070 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.827400 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.827709 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.828054 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.828374 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.828676 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.829010 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.829330 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.829731 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.830042 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.830342 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.830645 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.830989 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.831300 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.831603 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.831943 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.832265 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.832576 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.832892 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.833193 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.833509 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.833829 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.834140 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.834447 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.835008 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.835313 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.835627 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.835963 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.836287 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.836598 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.836902 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.837211 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.837514 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.837822 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.838146 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.838718 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.839058 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.839371 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.839681 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.840026 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.840349 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.840675 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.841002 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.841417 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.841660 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.841970 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.842273 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.842587 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.842891 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.843199 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.843504 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.843844 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.844140 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.844963 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.845466 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.845940 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.846253 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.846586 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.846854 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.847166 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.847466 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.847826 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.848130 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.848436 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.848740 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.849045 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.849388 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.849691 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.850033 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.850362 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.850701 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.851007 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.851310 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.851629 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.851975 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.852281 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.852586 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.852894 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.853203 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.853504 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.853812 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.854118 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.854423 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.854731 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.855031 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.855337 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.855642 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.855984 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.856292 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.856597 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.856898 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.857199 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.857503 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.857804 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.858118 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.858411 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.858725 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.859035 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.859329 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.859630 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.859968 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.860416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.860784 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.861107 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.861418 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.861726 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.862034 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.862345 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.862905 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.863421 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.863734 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.864086 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.864414 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.864714 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.865023 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.865334 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.865644 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.865949 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.866257 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.866561 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.866862 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.867166 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.867469 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.867772 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.868116 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.868423 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.868726 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.869032 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.869335 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.869675 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.869978 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.870335 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.870638 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.870951 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.871273 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.871587 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.871937 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.872252 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.872550 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.872864 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.873174 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.873487 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.873791 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.874092 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.874420 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.874725 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.875030 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.875350 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.875879 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.876131 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.876444 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.876751 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.877067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.877378 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.877689 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.877998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.878306 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.878618 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.878924 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.879235 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.879546 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.879877 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.880195 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.880499 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.880804 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.881131 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.881443 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.881740 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.882051 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.882361 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.882676 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.882972 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.883411 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.883723 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.884068 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.884366 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.884676 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.884991 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.885304 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.885619 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.885924 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.886348 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.886654 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.886966 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.887278 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.887580 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.887908 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.888228 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.888554 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.888866 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.889154 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.889459 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.889783 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.890085 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.890403 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.890818 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.891136 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.892100 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.892578 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.892833 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.893144 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.893470 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.893791 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.894115 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.894421 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.894736 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.895045 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.895368 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.895696 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.896038 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.896357 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.896661 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.896996 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.897318 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.897630 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.897949 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.898464 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.898679 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.898990 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.899490 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.899653 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.899955 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.900252 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.900557 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.900960 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.901164 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.901489 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.901793 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.902105 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.902487 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.902725 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.903032 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.903371 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.903655 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.903989 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.904312 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.904624 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.905102 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.905262 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.905562 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.905884 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.906194 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.906551 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.906787 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.907804 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.908131 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.908439 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.908761 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.909096 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.909422 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.909733 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.910066 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.910401 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.910714 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.911033 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.911356 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.911662 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.911991 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.912302 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.912603 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.912906 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.913213 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.913522 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.913823 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.914126 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.914428 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.914751 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.915055 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.915380 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.915686 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.916024 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.916327 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.916629 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.916965 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.917267 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.917596 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.917912 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.918230 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.918558 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.918869 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.919189 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.919506 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.919842 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.920159 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.920477 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.920789 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.921103 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.921422 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.921728 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.922043 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.922349 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.922772 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.923344 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.923674 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.924021 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.924335 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.924646 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.924959 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.925275 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.925584 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.925894 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.926203 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.926514 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.927072 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.927402 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.927728 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.928142 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.928417 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.928797 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.929041 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.929356 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.929716 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.930032 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.930340 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.930649 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.930967 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.931283 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.931594 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.931950 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.932266 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.932570 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.932880 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.933189 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.933499 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.933812 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.934138 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.934715 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.935039 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.935353 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.935673 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.936014 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.936593 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.936893 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.937228 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.937554 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.937884 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.938263 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.938655 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.938981 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.939435 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.939594 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.939935 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.940340 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.940557 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.940882 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.941189 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.941745 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.942133 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.942486 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.942956 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.943286 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.943603 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.944105 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.944270 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.944602 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.944910 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.945234 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.945541 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.945852 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.946168 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.946481 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.946785 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.947085 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.947395 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.947711 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.948058 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.948471 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.949532 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.949532 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.949532 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.949877 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.949877 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.950250 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.950468 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.950759 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.951065 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.951367 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.951675 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.952014 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.952543 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.952861 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.953180 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.953491 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.954367 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.954748 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.955083 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.955391 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.955698 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.956054 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.956366 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.956690 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.957006 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.957319 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.957670 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.957986 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.958564 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.958897 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.959283 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.959907 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.960245 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.960555 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.960860 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.961166 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.961506 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.961819 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.962174 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.962494 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.963111 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.963211 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.963871 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.963970 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.964304 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.964616 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.964938 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.965257 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.965569 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.965884 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.966231 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.966557 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.966877 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.967190 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.967507 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.968015 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.968623 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.968856 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.969178 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.970210 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.970552 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.970871 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.971183 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.971617 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.971965 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.972292 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.972647 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.972924 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.973427 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.974050 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.974297 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.974631 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.974940 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.975273 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.975641 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.975999 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.976332 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.976642 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.976956 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.977257 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.977566 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.977905 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.978414 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.978814 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.979213 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.979532 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.979876 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.980182 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.980502 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.980791 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.981100 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.981404 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.981711 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.982018 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.982319 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.982628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.982927 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.983233 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.983538 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.983872 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.984183 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.984481 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.984782 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.985158 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.985490 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.985811 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.986134 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.986447 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.986769 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.987075 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.987397 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.987711 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.988054 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.988367 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.988694 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.989005 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.989317 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.989629 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.989940 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.990249 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.990562 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.990891 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.991216 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.991523 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.991870 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.992188 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.992511 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.992827 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.993141 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.993473 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.993776 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.994084 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.994399 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.994710 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.995022 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.995343 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.995653 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.996009 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.996336 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.996654 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.996972 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.997296 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.997654 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.997963 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.998307 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.998636 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.998950 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.999264 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.999566 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:50.999841 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 12:07:51.061188 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO dbcounter [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] Registered counter for database nova_api May 19 12:07:51.084045 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_db.sqlalchemy.engines [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:07:51.091731 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writer thread running {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:07:51.149607 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.context [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),792a11ae-0eb2-4d8f-8039-aee2984c4d9a(cell1) {{(pid=103475) load_cells /opt/stack/nova/nova/context.py:464}} May 19 12:07:51.155274 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:07:51.157046 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:07:51.158376 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:07:51.160456 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:07:51.162576 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO dbcounter [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] Registered counter for database nova_cell0 May 19 12:07:51.167043 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO dbcounter [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] Registered counter for database nova_cell1 May 19 12:07:51.175315 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_db.sqlalchemy.engines [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:07:51.177593 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_db.sqlalchemy.engines [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:07:51.183414 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writer thread running {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:07:51.184916 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writer thread running {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:07:51.339375 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO dbcounter [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] Registered counter for database nova_cell0 May 19 12:07:51.348048 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_db.sqlalchemy.engines [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:07:51.352691 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writer thread running {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:07:51.795026 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: WARNING keystonemiddleware.auth_token [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 12:07:51.803693 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: WARNING keystonemiddleware.auth_token [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 12:07:51.832483 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 12:07:51.833018 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 12:07:51.833889 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 12:07:51.834815 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 12:07:51.835277 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 12:07:51.835998 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.836622 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.837053 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.837465 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.838091 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.838656 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.839267 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.839897 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.840512 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.840993 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.841582 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.842216 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804757-28-iscsi {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.842758 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.843095 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.843499 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.844126 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.845386 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.845988 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.846567 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.847537 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.848161 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.848756 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.849148 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.849576 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.850163 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.850723 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.851303 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.851932 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.852567 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.853161 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.853887 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804757-28-iscsi {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.854479 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.855049 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.855598 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.856445 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.856847 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.857169 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.857624 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.858230 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.858821 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.859439 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.860628 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.861217 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.861809 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.862381 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.862966 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.863556 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.864190 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.864774 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.865351 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.865821 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.866412 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.867007 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.867427 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.867901 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.868385 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.868849 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.869436 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.870035 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.870620 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.871158 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.871514 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.872137 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.872724 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.873318 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.873902 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.874326 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.874941 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.875639 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.876723 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.877296 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.877902 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.878696 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.879160 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.879845 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.880370 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.880973 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.881897 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.881897 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.882484 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.883064 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.883628 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.884241 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.884845 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.885468 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.886044 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.886477 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.887049 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.887631 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.888298 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.888700 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.889282 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.889858 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.890433 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.891009 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.892164 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.892775 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.893318 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.893898 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.894451 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.894791 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.895262 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.895871 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.896486 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.897054 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.897632 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.898210 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.898793 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.899367 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.899967 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.900553 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.901141 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.901521 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.901856 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.902185 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.902519 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.902845 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.903169 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.903501 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.903841 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.904167 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.904493 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.904812 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.905129 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.905444 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.905759 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.906079 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.906392 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.906700 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.907723 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.908113 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.908457 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.908797 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.909120 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.909433 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.909749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.910085 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:07:51.910435 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.910773 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.911128 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.911697 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.911841 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.912147 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.912752 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.912869 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.913111 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.913446 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.913766 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.914083 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.914442 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.914726 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.915053 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.915396 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.915718 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.916073 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.916396 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.916713 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.917041 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.917372 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.917723 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.918034 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.918374 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.918733 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.919051 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.919381 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.919711 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.920062 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.920375 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.920688 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.921018 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.921376 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.921695 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.922022 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.922339 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.923297 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.923709 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.923921 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.924241 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.924591 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.924912 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.925232 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.925549 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.925871 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.926188 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.926505 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.926824 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.927139 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.928000 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.928000 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.928185 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.928397 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.928732 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.929078 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.929392 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.929744 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.930056 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.930368 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.930682 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.930996 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.931310 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.931640 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.931981 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.932301 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.932641 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.932959 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.933272 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.933602 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.933915 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.934228 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.934552 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.934870 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.935193 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.935510 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.935850 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.936189 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.936514 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.936831 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.937180 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.937523 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.937838 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.938797 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.939147 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.939464 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.939832 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.940150 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.940459 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.940770 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.941080 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.941394 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.941706 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.942018 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.942328 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.942638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.942947 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.943282 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.943599 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.943960 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.944272 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.944580 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.944940 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.945252 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.945598 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.945943 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.946278 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.946606 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.946924 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.947247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.947563 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.947994 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.948303 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.948527 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.949055 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.949184 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.949493 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.949810 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.950141 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.950459 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.950785 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.951094 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.951414 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.951762 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.952132 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.952455 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.952780 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.953144 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.953463 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.953802 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.954122 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.954444 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.954756 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.955078 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.955392 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.955717 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.956061 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.956391 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.956709 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.957062 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.957379 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.957695 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.958035 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.958378 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.958696 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.959012 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.959340 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.959935 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.960282 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.960570 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.960881 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.961190 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.961506 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.961824 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.962140 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.962455 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.962792 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.963110 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.963422 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.963733 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.964067 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.964383 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.964712 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.965029 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.965353 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.965685 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.965998 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.966301 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.966627 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.966942 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.967253 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.967565 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.967906 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.968246 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.968566 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.968876 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.969207 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.970186 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.970416 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.970663 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.970980 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.971291 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.971617 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.971962 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.972281 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.972601 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.972914 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.973240 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.973548 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.973875 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.974193 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.974509 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.974823 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.975133 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.975456 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.975772 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.976382 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.976714 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.977034 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.977358 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.977689 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.978013 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.978347 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.978675 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.979031 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.979338 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.979652 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.979988 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.980308 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.980617 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.980927 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.981232 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.981545 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.981855 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.982166 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.982473 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.982781 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.983092 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.983414 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.983722 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.984078 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.984395 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.984720 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.985967 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.986347 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.986728 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.987050 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.987396 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.987708 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.988113 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.988422 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.988774 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.989097 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.989401 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.989740 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.990049 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.990358 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.990666 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.990986 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.991304 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.991611 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.991960 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.992283 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.992599 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.992906 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.993219 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.993533 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.993841 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.994165 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.994478 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.994791 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.995103 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.995414 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.995725 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.996067 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.996383 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.996692 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.997030 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.997326 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.997641 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.997947 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.998260 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.998573 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.998884 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.999211 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.999526 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:51.999868 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.000185 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.000493 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.000856 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.001259 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.001575 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.001904 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.002229 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.002539 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.002853 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.003164 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.003474 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.003808 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.004212 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.004524 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.004831 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.005146 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.005450 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.005755 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.006080 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.006393 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.006704 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.007021 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.007326 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.007669 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.008004 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.008373 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.008676 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.008995 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.009321 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.009645 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.009964 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.010287 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.010589 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.010909 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.011228 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.011541 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.011874 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.012184 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.012508 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.012824 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.013140 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.013465 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.013790 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.014117 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.014426 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.014739 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.015055 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.015374 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.015687 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.016024 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.016500 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.016821 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.017139 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.017459 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.017775 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.018090 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.018406 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.018721 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.019032 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.019362 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.019677 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.020018 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.020338 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.020647 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.020963 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.021271 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.021711 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.022028 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.022352 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.022666 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.022979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.023289 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.023610 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.023964 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.024276 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.024698 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.025015 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.025332 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.025647 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.025956 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.026264 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.026580 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.026907 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.027215 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.027526 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.027860 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.028187 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.028498 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.028819 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.029236 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.029550 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.029865 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.030285 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.030602 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.030922 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.031244 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.031570 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.032576 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.032750 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.033222 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.033369 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.033699 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.034025 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.034344 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.034660 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.034969 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.035295 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.035621 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.035983 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.036312 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.036732 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.037063 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.037382 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.037704 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.038030 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.038349 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.038653 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.038962 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.039272 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.039580 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.039946 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.040262 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.040581 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.040896 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.041210 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.041540 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.041823 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.042151 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.042459 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.042804 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.043097 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.043424 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.043748 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.044083 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.044407 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.044720 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.045123 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.045361 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.045664 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.046014 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.046323 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.046648 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.046984 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.047335 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.047720 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.048574 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.049083 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.049408 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.049734 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.050063 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.050380 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.050688 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.050996 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.051314 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.051621 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.051954 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.052266 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.052576 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.052883 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.053188 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.053514 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.053823 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.054149 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.054461 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.054820 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.055135 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.055441 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.055823 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.056120 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.056458 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.056782 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.057110 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.057444 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.057758 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.058087 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.058408 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.058727 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.059048 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.059366 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.059686 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.060025 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.060359 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.060673 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.060994 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.061314 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.061636 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.062203 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.062534 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.062854 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.063251 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.063777 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.064110 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.064433 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.064749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.065067 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.065385 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.065702 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.066039 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.066368 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.066698 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.067040 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.067365 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.067684 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.068099 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.068424 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.068783 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.069105 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.069421 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.069745 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.070070 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.070389 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.070709 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.071027 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.071346 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.071664 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.072009 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.072331 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.072645 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.072961 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.073291 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.073632 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.073966 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.074283 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.074600 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.074919 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.075458 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.075772 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.076132 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.076463 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.076791 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.077116 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.077435 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.077765 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.078083 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.078400 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.078723 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.079053 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.079362 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.079691 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.080035 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.080351 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.080676 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.080989 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.081524 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.081877 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.082224 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.082523 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.082860 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.083182 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.083494 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.083837 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.084153 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.084467 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.085046 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.085362 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.085673 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.085983 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.086307 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.086615 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.086926 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.087243 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.087561 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.087915 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.088236 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.088548 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.088857 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.089175 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.089483 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.089792 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.090104 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.090414 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.090734 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.091044 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.091358 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.091722 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.091998 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.092308 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.092621 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.092974 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.093300 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.093612 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.093922 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.094247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.095070 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.095399 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.095715 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.096058 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.096411 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.096733 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.097271 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.097608 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.097933 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.098275 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.098611 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.098928 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.099241 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.099554 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.099903 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.100222 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.100539 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.100858 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.101171 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.101487 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.101797 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.102111 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.102424 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.102737 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.103049 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.103357 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.103669 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.104014 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.104368 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.104693 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.105008 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.105330 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.105654 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.105977 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.106286 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.106602 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.106918 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.107240 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.107576 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.107916 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.108229 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.108667 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.108985 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.109304 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.109630 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.110628 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.110832 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.111160 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.111478 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.111825 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.112143 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.112480 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.112824 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.113159 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.113488 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.113801 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.114113 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.114431 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.114734 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.115057 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.115378 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.115686 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.116027 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.116341 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.116652 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.116962 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.117272 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.117581 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.117902 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.118202 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.118511 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.118822 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.119127 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.119440 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.119746 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.120080 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.120389 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.120708 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.121014 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.121321 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.121627 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.121963 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.122784 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.122784 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.123041 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.123319 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.123537 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.123878 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.124206 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.124523 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.124844 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.125165 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.125496 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.125855 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.126172 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.126590 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.126909 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.127230 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.127543 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.127903 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.128246 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.128551 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.128883 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.129206 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.129535 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.129855 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.130171 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.130508 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.130826 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.131140 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.131466 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.131778 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.132115 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.132439 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.132827 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.133085 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.133418 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.133734 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.134064 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.134400 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.134754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.135074 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.135428 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.135759 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.136107 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.136423 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.136734 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:07:52.136981 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 12:07:52.169340 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: WARNING keystonemiddleware.auth_token [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 12:07:52.177064 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: WARNING keystonemiddleware.auth_token [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 12:07:52.182412 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d8b00f89c0 pid: 103475 (default app) May 19 12:07:52.184539 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:07:52.185759 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001824 May 19 12:07:52.186167 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Thu May 19 12:07:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:07:52.199247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO dbcounter [None req-41645325-347d-4997-b4fb-8332f7e6391d None None] Registered counter for database nova_api May 19 12:07:52.221800 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG oslo_db.sqlalchemy.engines [None req-41645325-347d-4997-b4fb-8332f7e6391d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:07:52.229199 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writer thread running {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:07:52.289906 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.context [None req-41645325-347d-4997-b4fb-8332f7e6391d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),792a11ae-0eb2-4d8f-8039-aee2984c4d9a(cell1) {{(pid=103476) load_cells /opt/stack/nova/nova/context.py:464}} May 19 12:07:52.296059 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG oslo_concurrency.lockutils [None req-41645325-347d-4997-b4fb-8332f7e6391d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:07:52.297626 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG oslo_concurrency.lockutils [None req-41645325-347d-4997-b4fb-8332f7e6391d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:07:52.298509 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG oslo_concurrency.lockutils [None req-41645325-347d-4997-b4fb-8332f7e6391d None None] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:07:52.300861 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG oslo_concurrency.lockutils [None req-41645325-347d-4997-b4fb-8332f7e6391d None None] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:07:52.303146 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO dbcounter [None req-41645325-347d-4997-b4fb-8332f7e6391d None None] Registered counter for database nova_cell0 May 19 12:07:52.307746 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO dbcounter [None req-41645325-347d-4997-b4fb-8332f7e6391d None None] Registered counter for database nova_cell1 May 19 12:07:52.317199 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG oslo_db.sqlalchemy.engines [None req-41645325-347d-4997-b4fb-8332f7e6391d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:07:52.319967 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG oslo_db.sqlalchemy.engines [None req-41645325-347d-4997-b4fb-8332f7e6391d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:07:52.327563 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writer thread running {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:07:52.327940 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writer thread running {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:07:52.480026 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO dbcounter [None req-41645325-347d-4997-b4fb-8332f7e6391d None None] Registered counter for database nova_cell0 May 19 12:07:52.490354 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG oslo_db.sqlalchemy.engines [None req-41645325-347d-4997-b4fb-8332f7e6391d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:07:52.496443 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writer thread running {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:07:52.833545 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: WARNING keystonemiddleware.auth_token [None req-41645325-347d-4997-b4fb-8332f7e6391d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 12:07:52.841488 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: WARNING keystonemiddleware.auth_token [None req-41645325-347d-4997-b4fb-8332f7e6391d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 12:07:53.198971 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: WARNING keystonemiddleware.auth_token [None req-41645325-347d-4997-b4fb-8332f7e6391d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 12:07:53.205758 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: WARNING keystonemiddleware.auth_token [None req-41645325-347d-4997-b4fb-8332f7e6391d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 12:07:53.211428 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d8b00f89c0 pid: 103476 (default app) May 19 12:09:16.294098 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:09:16.295310 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001678 May 19 12:09:16.295652 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 19 12:09:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:09:16.310695 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writing DB stats nova_api:SELECT=3 {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:16.312576 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writing DB stats nova_cell0:SELECT=3 {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:16.313978 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writing DB stats nova_cell1:SELECT=3 {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:16.314974 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writing DB stats nova_cell0:SELECT=3 {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:16.940718 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-888bb1ff-3c71-4b80-aabc-988d86827d0e admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:09:16.976243 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-888bb1ff-3c71-4b80-aabc-988d86827d0e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.672074 May 19 12:09:16.976995 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1291 bytes} [Thu May 19 12:09:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:09:19.356408 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:09:19.360573 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-61e6e64a-5d96-4af2-bf89-2b6ec2dd7c87 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003149 May 19 12:09:19.361027 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 19 12:09:19 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:09:19.428180 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-8b63f5ac-21d5-40ef-899b-9f53857f2fb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 256, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:19.448205 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:09:19.448205 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: warnings.warn(msg) May 19 12:09:19.630125 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-8b63f5ac-21d5-40ef-899b-9f53857f2fb7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.262621 May 19 12:09:19.636866 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 19 12:09:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:09:19.645143 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_api:SELECT=3 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:19.646581 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_cell1:SELECT=3 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:19.647690 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_cell0:SELECT=3 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:19.648592 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:19.857146 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-85b30257-f750-4c18-adb6-752039430752 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:19.860355 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:09:19.860355 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: warnings.warn(msg) May 19 12:09:19.997112 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-85b30257-f750-4c18-adb6-752039430752 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.357912 May 19 12:09:19.997815 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1335 bytes} [Thu May 19 12:09:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:09:22.378004 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-8b63f5ac-21d5-40ef-899b-9f53857f2fb7 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:09:22.379033 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-8b63f5ac-21d5-40ef-899b-9f53857f2fb7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 19 12:09:22.379437 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 19 12:09:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:09:22.494199 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-2a37a7f2-d999-4865-b1b4-f7942602c551 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1", "rxtx_factor": 1.0, "ram": 512}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:22.512956 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:09:22.512956 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: warnings.warn(msg) May 19 12:09:22.649031 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-2a37a7f2-d999-4865-b1b4-f7942602c551 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.263489 May 19 12:09:22.649844 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 19 12:09:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:09:22.670539 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-fcf10a4d-50b4-4dbb-9f4c-31d1a9f918e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:22.672761 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:09:22.672761 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: warnings.warn(msg) May 19 12:09:22.799917 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-fcf10a4d-50b4-4dbb-9f4c-31d1a9f918e4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.141042 May 19 12:09:22.801079 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1335 bytes} [Thu May 19 12:09:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:09:25.186283 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-2a37a7f2-d999-4865-b1b4-f7942602c551 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:09:25.188009 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-2a37a7f2-d999-4865-b1b4-f7942602c551 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002043 May 19 12:09:25.188786 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 19 12:09:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:09:25.261079 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-083ab932-4aed-4579-80fc-b12cb7d223e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:25.345880 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-083ab932-4aed-4579-80fc-b12cb7d223e7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150050 May 19 12:09:25.346558 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 19 12:09:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 12:09:25.360691 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-c9a1f161-b7a3-4f8f-aea4-db273db6a289 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:25.464791 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-c9a1f161-b7a3-4f8f-aea4-db273db6a289 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109011 May 19 12:09:25.465603 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1335 bytes} [Thu May 19 12:09:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:09:27.820328 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-083ab932-4aed-4579-80fc-b12cb7d223e7 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:09:27.821421 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-083ab932-4aed-4579-80fc-b12cb7d223e7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 May 19 12:09:27.821821 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 19 12:09:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:09:27.891283 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-d52feccd-cd94-4117-b22f-c00c14a1cc9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:28.001050 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-d52feccd-cd94-4117-b22f-c00c14a1cc9d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.167582 May 19 12:09:28.001050 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 19 12:09:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 12:09:28.010124 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-e7e05358-9047-4aa6-a08c-f8800e3982f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:28.094734 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-e7e05358-9047-4aa6-a08c-f8800e3982f3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088464 May 19 12:09:28.095330 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1335 bytes} [Thu May 19 12:09:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:09:30.574915 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-d52feccd-cd94-4117-b22f-c00c14a1cc9d admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:09:30.576663 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-d52feccd-cd94-4117-b22f-c00c14a1cc9d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002188 May 19 12:09:30.577793 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 19 12:09:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:09:30.641194 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-3fd1b42e-47ac-4438-82f0-fd138c7e4099 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "id": "d4", "name": "ds4G", "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:30.720183 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-3fd1b42e-47ac-4438-82f0-fd138c7e4099 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135986 May 19 12:09:30.727508 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 19 12:09:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 12:09:30.733097 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-6ce98a08-03b7-4e04-b517-81145bea33e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:30.842874 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-6ce98a08-03b7-4e04-b517-81145bea33e9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113790 May 19 12:09:30.843875 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1335 bytes} [Thu May 19 12:09:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:09:33.296666 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-3fd1b42e-47ac-4438-82f0-fd138c7e4099 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:09:33.297696 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-3fd1b42e-47ac-4438-82f0-fd138c7e4099 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002038 May 19 12:09:33.300218 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 19 12:09:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:09:33.367306 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-b7403e94-7e11-4ec5-8ec6-67542384e5f6 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:09:33.392827 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-b7403e94-7e11-4ec5-8ec6-67542384e5f6 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088509 May 19 12:09:33.393557 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1291 bytes} [Thu May 19 12:09:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:09:35.756955 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-3fd1b42e-47ac-4438-82f0-fd138c7e4099 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:09:35.757991 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-3fd1b42e-47ac-4438-82f0-fd138c7e4099 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 May 19 12:09:35.758406 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 19 12:09:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:09:35.826121 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-f5f4035e-6033-456a-8050-3b1f0661092f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "id": "1", "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:35.940396 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-f5f4035e-6033-456a-8050-3b1f0661092f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.175598 May 19 12:09:35.940990 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 19 12:09:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:09:35.954033 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-96c07cbe-9538-4b70-9ac2-320910bc7484 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:36.066494 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-96c07cbe-9538-4b70-9ac2-320910bc7484 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116879 May 19 12:09:36.067084 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1332 bytes} [Thu May 19 12:09:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:09:38.677075 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-f5f4035e-6033-456a-8050-3b1f0661092f admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:09:38.678711 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-f5f4035e-6033-456a-8050-3b1f0661092f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002089 May 19 12:09:38.679275 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 19 12:09:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:09:38.743242 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-5a3c9a49-88b0-4a35-9e6a-53b3ef57ebce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "swap": 0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:38.865573 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-5a3c9a49-88b0-4a35-9e6a-53b3ef57ebce admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.180043 May 19 12:09:38.866154 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 19 12:09:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:09:38.878714 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-0f405c06-d6d6-424e-81f2-9536829b6478 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:38.996027 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-0f405c06-d6d6-424e-81f2-9536829b6478 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.121027 May 19 12:09:38.996647 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1332 bytes} [Thu May 19 12:09:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:09:41.638537 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-5a3c9a49-88b0-4a35-9e6a-53b3ef57ebce admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:09:41.639981 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-5a3c9a49-88b0-4a35-9e6a-53b3ef57ebce admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 May 19 12:09:41.640490 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 19 12:09:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:09:41.708110 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-4aa73a65-9037-4ed1-9d61-25c1db6ffb4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "disk": 40, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "3", "ram": 4096}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:41.782957 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-4aa73a65-9037-4ed1-9d61-25c1db6ffb4d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.135962 May 19 12:09:41.783703 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 19 12:09:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:09:41.804309 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-0bcfb865-7096-44bd-8a68-abacd35a58d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:41.915941 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-0bcfb865-7096-44bd-8a68-abacd35a58d8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118528 May 19 12:09:41.916522 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1332 bytes} [Thu May 19 12:09:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:09:44.722453 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-4aa73a65-9037-4ed1-9d61-25c1db6ffb4d admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:09:44.723473 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-4aa73a65-9037-4ed1-9d61-25c1db6ffb4d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 19 12:09:44.723908 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 19 12:09:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:09:44.793072 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-97c01dea-8237-46b7-b44e-577dffe50956 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "disk": 80, "ram": 8192, "rxtx_factor": 1.0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:44.871115 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-97c01dea-8237-46b7-b44e-577dffe50956 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.140789 May 19 12:09:44.872028 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 19 12:09:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:09:44.884840 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-3dd6c9ff-3db5-4e4b-b6a4-325495b9672e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:44.989207 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-3dd6c9ff-3db5-4e4b-b6a4-325495b9672e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107896 May 19 12:09:45.003819 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1332 bytes} [Thu May 19 12:09:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:09:47.542556 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-97c01dea-8237-46b7-b44e-577dffe50956 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:09:47.543993 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-97c01dea-8237-46b7-b44e-577dffe50956 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003893 May 19 12:09:47.544412 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 19 12:09:47 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:09:47.617054 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-8ae2abb6-cc04-4dd4-956a-8ddd04920dd7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "disk": 160, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:47.701190 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-8ae2abb6-cc04-4dd4-956a-8ddd04920dd7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.149546 May 19 12:09:47.701664 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 19 12:09:47 2022] POST /compute/v2.1/flavors => generated 408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:09:47.714368 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-676fe153-d848-4b07-b6ef-ff09d2a7a44d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:09:47.720420 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:47.813447 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-676fe153-d848-4b07-b6ef-ff09d2a7a44d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102849 May 19 12:09:47.814689 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1332 bytes} [Thu May 19 12:09:47 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:10:13.018969 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-8ae2abb6-cc04-4dd4-956a-8ddd04920dd7 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:13.020619 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-8ae2abb6-cc04-4dd4-956a-8ddd04920dd7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001960 May 19 12:10:13.020985 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 19 12:10:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:10:13.092271 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-ec1e9256-f069-4608-83e4-fe7b418cdab2 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:13.111011 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-ec1e9256-f069-4608-83e4-fe7b418cdab2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.083317 May 19 12:10:13.111562 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1291 bytes} [Thu May 19 12:10:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:10:14.154829 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-8ae2abb6-cc04-4dd4-956a-8ddd04920dd7 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:14.156306 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-8ae2abb6-cc04-4dd4-956a-8ddd04920dd7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002001 May 19 12:10:14.156719 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 19 12:10:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:10:14.363716 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-4fa9d291-e6ce-45e5-a0d3-3d6f0ff293e4 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:14.369508 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.wsgi [None req-4fa9d291-e6ce-45e5-a0d3-3d6f0ff293e4 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-4fa9d291-e6ce-45e5-a0d3-3d6f0ff293e4 admin admin] Request method failure captured: May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Accept: application/json May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Accept-Encoding: gzip, deflate May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Connection: keep-alive May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Content-Length: 0 May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Host: 10.222.0.23 May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Openstack-Api-Version: compute 2.90 May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Openstack-System-Scope: None May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: User-Agent: python-novaclient May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Auth-Token: gAAAAABihjOmiJc-F9xJSEnsumQDUkmym20fZBOAE8uq_euglD290RcQp3pVObWwPqMDu5jptZAkaCk4Rv4Px6igG3lC84JIqG_7VI8CTUq39KFSij17jwoCGF12HUiLB0VivaxM-lFyQtOMEBDBfVQyU1teHIoCOXJs54pZQLt2w-amVNpC0Ho May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Domain-Id: None May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Domain-Name: None May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Identity-Status: Confirmed May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Is-Admin-Project: True May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Openstack-Nova-Api-Version: 2.90 May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Project-Domain-Id: default May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Project-Domain-Name: Default May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Project-Id: f3569780f2fe4b24b4109e2eee3c26fe May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Project-Name: admin May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Role: member,admin,reader May 19 12:10:14.372754 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Roles: member,admin,reader May 19 12:10:14.375600 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:10:14.375600 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Tenant: admin May 19 12:10:14.375600 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Tenant-Id: f3569780f2fe4b24b4109e2eee3c26fe May 19 12:10:14.375600 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Tenant-Name: admin May 19 12:10:14.375600 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-User: admin May 19 12:10:14.375600 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-User-Domain-Id: default May 19 12:10:14.375600 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-User-Domain-Name: Default May 19 12:10:14.375600 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-User-Id: 11855e565a88475189d279de9469c271 May 19 12:10:14.375600 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-User-Name: admin May 19 12:10:14.375600 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: method: > May 19 12:10:14.375600 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: exception: Flavor 42 could not be found. May 19 12:10:14.375600 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: action_args: {'id': '42'} May 19 12:10:14.375600 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:10:14.375600 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:10:14.376638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 12:10:14.376638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 12:10:14.376638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 12:10:14.376638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 12:10:14.376638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 12:10:14.376638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 12:10:14.376638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 12:10:14.376638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 12:10:14.376638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 12:10:14.376638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:10:14.376638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 12:10:14.376638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 12:10:14.376638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 12:10:14.376638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi May 19 12:10:14.376638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:10:14.376638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi May 19 12:10:14.376638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:10:14.376638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:10:14.376638 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:10:14.378247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:10:14.378247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:10:14.378247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:10:14.378247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:10:14.378247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 12:10:14.378247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 12:10:14.378247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 12:10:14.378247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi May 19 12:10:14.378247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:10:14.378247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi May 19 12:10:14.378247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:10:14.378247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:10:14.378247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:10:14.378247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:10:14.378247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:10:14.378247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 12:10:14.378247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi May 19 12:10:14.378247 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-4fa9d291-e6ce-45e5-a0d3-3d6f0ff293e4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:10:14.379540 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-4fa9d291-e6ce-45e5-a0d3-3d6f0ff293e4 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.069271 May 19 12:10:14.379540 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Thu May 19 12:10:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 12:10:14.384988 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-a5cc43e2-bc02-4fce-985a-48e2f7e8c01f admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:14.388008 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:14.407184 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-a5cc43e2-bc02-4fce-985a-48e2f7e8c01f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025732 May 19 12:10:14.407757 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Thu May 19 12:10:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:10:14.418041 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-206e39de-7f67-4de4-aebb-6e161c00da6e admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:14.440867 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-206e39de-7f67-4de4-aebb-6e161c00da6e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026745 May 19 12:10:14.441435 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Thu May 19 12:10:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:10:14.451053 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-383b8b4b-d0b4-47b6-a3b6-c065bd835ba9 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:14.457697 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.wsgi [None req-383b8b4b-d0b4-47b6-a3b6-c065bd835ba9 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-383b8b4b-d0b4-47b6-a3b6-c065bd835ba9 admin admin] Request method failure captured: May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Accept: application/json May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Accept-Encoding: gzip, deflate May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Connection: keep-alive May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Content-Length: 0 May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Host: 10.222.0.23 May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Openstack-Api-Version: compute 2.90 May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Openstack-System-Scope: None May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: User-Agent: python-novaclient May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Auth-Token: gAAAAABihjOmiJc-F9xJSEnsumQDUkmym20fZBOAE8uq_euglD290RcQp3pVObWwPqMDu5jptZAkaCk4Rv4Px6igG3lC84JIqG_7VI8CTUq39KFSij17jwoCGF12HUiLB0VivaxM-lFyQtOMEBDBfVQyU1teHIoCOXJs54pZQLt2w-amVNpC0Ho May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Domain-Id: None May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Domain-Name: None May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Identity-Status: Confirmed May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Is-Admin-Project: True May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Openstack-Nova-Api-Version: 2.90 May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Project-Domain-Id: default May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Project-Domain-Name: Default May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Project-Id: f3569780f2fe4b24b4109e2eee3c26fe May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Project-Name: admin May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Role: member,admin,reader May 19 12:10:14.460998 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Roles: member,admin,reader May 19 12:10:14.462918 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:10:14.462918 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Tenant: admin May 19 12:10:14.462918 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Tenant-Id: f3569780f2fe4b24b4109e2eee3c26fe May 19 12:10:14.462918 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Tenant-Name: admin May 19 12:10:14.462918 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-User: admin May 19 12:10:14.462918 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-User-Domain-Id: default May 19 12:10:14.462918 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-User-Domain-Name: Default May 19 12:10:14.462918 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-User-Id: 11855e565a88475189d279de9469c271 May 19 12:10:14.462918 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-User-Name: admin May 19 12:10:14.462918 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: method: > May 19 12:10:14.462918 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: exception: Flavor 42 could not be found. May 19 12:10:14.462918 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: action_args: {'id': '42'} May 19 12:10:14.462918 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:10:14.462918 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:10:14.464067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 12:10:14.464067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 12:10:14.464067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 12:10:14.464067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 12:10:14.464067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 12:10:14.464067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 12:10:14.464067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 12:10:14.464067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 12:10:14.464067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 12:10:14.464067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:10:14.464067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 12:10:14.464067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 12:10:14.464067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 12:10:14.464067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 19 12:10:14.464067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:10:14.464067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 19 12:10:14.464067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:10:14.464067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:10:14.464067 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:10:14.465221 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:10:14.465221 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:10:14.465221 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:10:14.465221 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:10:14.465221 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 12:10:14.465221 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 12:10:14.465221 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 12:10:14.465221 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 19 12:10:14.465221 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:10:14.465221 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 19 12:10:14.465221 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:10:14.465221 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:10:14.465221 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:10:14.465221 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:10:14.465221 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:10:14.465221 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 12:10:14.465221 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 19 12:10:14.465221 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-383b8b4b-d0b4-47b6-a3b6-c065bd835ba9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:10:14.466273 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-383b8b4b-d0b4-47b6-a3b6-c065bd835ba9 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015272 May 19 12:10:14.466273 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Thu May 19 12:10:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 12:10:15.375171 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-206e39de-7f67-4de4-aebb-6e161c00da6e admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:15.376335 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-206e39de-7f67-4de4-aebb-6e161c00da6e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 May 19 12:10:15.376741 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 19 12:10:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:10:15.569696 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-d28b9acd-2734-472d-8a5b-765c0677b0d2 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:15.575619 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.wsgi [None req-d28b9acd-2734-472d-8a5b-765c0677b0d2 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-d28b9acd-2734-472d-8a5b-765c0677b0d2 admin admin] Request method failure captured: May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Accept: application/json May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Accept-Encoding: gzip, deflate May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Connection: keep-alive May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Content-Length: 0 May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Host: 10.222.0.23 May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Openstack-Api-Version: compute 2.90 May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Openstack-System-Scope: None May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: User-Agent: python-novaclient May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Auth-Token: gAAAAABihjOnB-6khbZ0GEG6KklC8M3woVdrinimMkuaYdxLmiZymATB0Oj65bOLnG88Td-s4mcdQm4h1IV8saxEb3S6COTRmApo8FX-vvES9Jpwc3zIusDsII_PKYEzjt-F6o726PUve8H_pnQ2IoMOhXX8qEhJQyHo1i_5pg7yiGi8dO516G0 May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Domain-Id: None May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Domain-Name: None May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Identity-Status: Confirmed May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Is-Admin-Project: True May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Openstack-Nova-Api-Version: 2.90 May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Project-Domain-Id: default May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Project-Domain-Name: Default May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Project-Id: f3569780f2fe4b24b4109e2eee3c26fe May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Project-Name: admin May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Role: member,admin,reader May 19 12:10:15.577919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Roles: member,admin,reader May 19 12:10:15.579566 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:10:15.579566 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Tenant: admin May 19 12:10:15.579566 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Tenant-Id: f3569780f2fe4b24b4109e2eee3c26fe May 19 12:10:15.579566 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Tenant-Name: admin May 19 12:10:15.579566 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-User: admin May 19 12:10:15.579566 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-User-Domain-Id: default May 19 12:10:15.579566 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-User-Domain-Name: Default May 19 12:10:15.579566 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-User-Id: 11855e565a88475189d279de9469c271 May 19 12:10:15.579566 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-User-Name: admin May 19 12:10:15.579566 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: method: > May 19 12:10:15.579566 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: exception: Flavor 84 could not be found. May 19 12:10:15.579566 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: action_args: {'id': '84'} May 19 12:10:15.579566 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:10:15.579566 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:10:15.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 12:10:15.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 12:10:15.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 12:10:15.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 12:10:15.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 12:10:15.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 12:10:15.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 12:10:15.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 12:10:15.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 12:10:15.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:10:15.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 12:10:15.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 12:10:15.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 12:10:15.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 19 12:10:15.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:10:15.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 19 12:10:15.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:10:15.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:10:15.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:10:15.581754 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:10:15.581754 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:10:15.581754 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:10:15.581754 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:10:15.581754 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 12:10:15.581754 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 12:10:15.581754 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 12:10:15.581754 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 19 12:10:15.581754 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:10:15.581754 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 19 12:10:15.581754 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:10:15.581754 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:10:15.581754 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:10:15.581754 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:10:15.581754 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:10:15.581754 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 12:10:15.581754 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 19 12:10:15.581754 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-d28b9acd-2734-472d-8a5b-765c0677b0d2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:10:15.586335 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-d28b9acd-2734-472d-8a5b-765c0677b0d2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.064073 May 19 12:10:15.586335 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Thu May 19 12:10:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 12:10:15.589424 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-a4dc3642-6b9d-46f3-926c-beadbe8a3c2f admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:15.603292 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-a4dc3642-6b9d-46f3-926c-beadbe8a3c2f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017617 May 19 12:10:15.603856 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Thu May 19 12:10:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:10:15.614069 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-aa498908-1a44-4d91-a663-3a5a66293ef2 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:15.628831 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-aa498908-1a44-4d91-a663-3a5a66293ef2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018617 May 19 12:10:15.629375 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Thu May 19 12:10:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:10:15.639887 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-cbe8ff69-1e67-4555-b870-6b3337cbd72e admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:15.645464 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.wsgi [None req-cbe8ff69-1e67-4555-b870-6b3337cbd72e admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-cbe8ff69-1e67-4555-b870-6b3337cbd72e admin admin] Request method failure captured: May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Accept: application/json May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Accept-Encoding: gzip, deflate May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Connection: keep-alive May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Content-Length: 0 May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Host: 10.222.0.23 May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Openstack-Api-Version: compute 2.90 May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Openstack-System-Scope: None May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: User-Agent: python-novaclient May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Auth-Token: gAAAAABihjOnB-6khbZ0GEG6KklC8M3woVdrinimMkuaYdxLmiZymATB0Oj65bOLnG88Td-s4mcdQm4h1IV8saxEb3S6COTRmApo8FX-vvES9Jpwc3zIusDsII_PKYEzjt-F6o726PUve8H_pnQ2IoMOhXX8qEhJQyHo1i_5pg7yiGi8dO516G0 May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Domain-Id: None May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Domain-Name: None May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Identity-Status: Confirmed May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Is-Admin-Project: True May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Openstack-Nova-Api-Version: 2.90 May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Project-Domain-Id: default May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Project-Domain-Name: Default May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Project-Id: f3569780f2fe4b24b4109e2eee3c26fe May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Project-Name: admin May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Role: member,admin,reader May 19 12:10:15.646979 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Roles: member,admin,reader May 19 12:10:15.648607 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:10:15.648607 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Tenant: admin May 19 12:10:15.648607 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Tenant-Id: f3569780f2fe4b24b4109e2eee3c26fe May 19 12:10:15.648607 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Tenant-Name: admin May 19 12:10:15.648607 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-User: admin May 19 12:10:15.648607 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-User-Domain-Id: default May 19 12:10:15.648607 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-User-Domain-Name: Default May 19 12:10:15.648607 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-User-Id: 11855e565a88475189d279de9469c271 May 19 12:10:15.648607 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-User-Name: admin May 19 12:10:15.648607 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: method: > May 19 12:10:15.648607 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: exception: Flavor 84 could not be found. May 19 12:10:15.648607 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: action_args: {'id': '84'} May 19 12:10:15.648607 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:10:15.648607 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:10:15.649429 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 12:10:15.649429 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 12:10:15.649429 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 12:10:15.649429 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 12:10:15.649429 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 12:10:15.649429 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 12:10:15.649429 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 12:10:15.649429 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 12:10:15.649429 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 12:10:15.649429 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:10:15.649429 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 12:10:15.649429 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 12:10:15.649429 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 12:10:15.649429 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi May 19 12:10:15.649429 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:10:15.649429 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi May 19 12:10:15.649429 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:10:15.649429 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:10:15.649429 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:10:15.650496 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:10:15.650496 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:10:15.650496 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:10:15.650496 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:10:15.650496 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 12:10:15.650496 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 12:10:15.650496 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 12:10:15.650496 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi May 19 12:10:15.650496 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:10:15.650496 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi May 19 12:10:15.650496 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:10:15.650496 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:10:15.650496 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:10:15.650496 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:10:15.650496 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:10:15.650496 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 12:10:15.650496 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi May 19 12:10:15.650496 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-cbe8ff69-1e67-4555-b870-6b3337cbd72e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:10:15.651966 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-cbe8ff69-1e67-4555-b870-6b3337cbd72e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013101 May 19 12:10:15.651966 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Thu May 19 12:10:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 12:10:16.575184 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-aa498908-1a44-4d91-a663-3a5a66293ef2 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:16.577019 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-aa498908-1a44-4d91-a663-3a5a66293ef2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001732 May 19 12:10:16.578013 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 19 12:10:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:10:16.772217 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-3c2ce793-27a9-4fb6-9ad0-3a3d0c594074 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:16.778166 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.wsgi [None req-3c2ce793-27a9-4fb6-9ad0-3a3d0c594074 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-3c2ce793-27a9-4fb6-9ad0-3a3d0c594074 admin admin] Request method failure captured: May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Accept: application/json May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Accept-Encoding: gzip, deflate May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Connection: keep-alive May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Content-Length: 0 May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Host: 10.222.0.23 May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Openstack-Api-Version: compute 2.90 May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Openstack-System-Scope: None May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: User-Agent: python-novaclient May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Auth-Token: gAAAAABihjOouWurDAtVr4AkE941JDzI9KyvnDQDsDLo9vw3QRSTIcuFN2CcAowmngsNyr-MIFA_JVAFD3uBCi9z_yO1gTxOh6guxD3UkZvO6T7wX8RGn2bN9sObm6VpObvKwtOXvLBywOIHI0Ztoag0pNVgAPD2nX7V-ZP2tqd5umkHOy2hGn4 May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Domain-Id: None May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Domain-Name: None May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Identity-Status: Confirmed May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Is-Admin-Project: True May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Openstack-Nova-Api-Version: 2.90 May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Project-Domain-Id: default May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Project-Domain-Name: Default May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Project-Id: f3569780f2fe4b24b4109e2eee3c26fe May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Project-Name: admin May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Role: member,admin,reader May 19 12:10:16.780518 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Roles: member,admin,reader May 19 12:10:16.781930 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:10:16.781930 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Tenant: admin May 19 12:10:16.781930 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Tenant-Id: f3569780f2fe4b24b4109e2eee3c26fe May 19 12:10:16.781930 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-Tenant-Name: admin May 19 12:10:16.781930 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-User: admin May 19 12:10:16.781930 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-User-Domain-Id: default May 19 12:10:16.781930 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-User-Domain-Name: Default May 19 12:10:16.781930 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-User-Id: 11855e565a88475189d279de9469c271 May 19 12:10:16.781930 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: X-User-Name: admin May 19 12:10:16.781930 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: method: > May 19 12:10:16.781930 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: exception: Flavor 451 could not be found. May 19 12:10:16.781930 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: action_args: {'id': '451'} May 19 12:10:16.781930 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:10:16.781930 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:10:16.782749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 12:10:16.782749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 12:10:16.782749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 12:10:16.782749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 12:10:16.782749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 12:10:16.782749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 12:10:16.782749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 12:10:16.782749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 12:10:16.782749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 12:10:16.782749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:10:16.782749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 12:10:16.782749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 12:10:16.782749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 12:10:16.782749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi May 19 12:10:16.782749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:10:16.782749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi May 19 12:10:16.782749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:10:16.782749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:10:16.782749 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:10:16.783904 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:10:16.783904 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:10:16.783904 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:10:16.783904 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:10:16.783904 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 12:10:16.783904 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 12:10:16.783904 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 12:10:16.783904 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi May 19 12:10:16.783904 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:10:16.783904 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi May 19 12:10:16.783904 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:10:16.783904 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:10:16.783904 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:10:16.783904 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:10:16.783904 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:10:16.783904 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 12:10:16.783904 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi May 19 12:10:16.783904 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-3c2ce793-27a9-4fb6-9ad0-3a3d0c594074 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:10:16.785019 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-3c2ce793-27a9-4fb6-9ad0-3a3d0c594074 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062871 May 19 12:10:16.785019 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Thu May 19 12:10:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 12:10:16.791744 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-cfe9663b-160a-44d1-82d7-a8d8abcbc44f admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:16.805800 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-cfe9663b-160a-44d1-82d7-a8d8abcbc44f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017554 May 19 12:10:16.806355 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Thu May 19 12:10:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:10:16.816385 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-f20211b7-b03c-42f1-b0f8-26e7cb4a98cd admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:16.832378 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-f20211b7-b03c-42f1-b0f8-26e7cb4a98cd admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019542 May 19 12:10:16.832928 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Thu May 19 12:10:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:10:16.843763 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-dbedd806-bd2b-43d6-b451-7c25f8a5cf40 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:16.849240 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.wsgi [None req-dbedd806-bd2b-43d6-b451-7c25f8a5cf40 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-dbedd806-bd2b-43d6-b451-7c25f8a5cf40 admin admin] Request method failure captured: May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Accept: application/json May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Accept-Encoding: gzip, deflate May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Connection: keep-alive May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Content-Length: 0 May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Host: 10.222.0.23 May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Openstack-Api-Version: compute 2.90 May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Openstack-System-Scope: None May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: User-Agent: python-novaclient May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Auth-Token: gAAAAABihjOouWurDAtVr4AkE941JDzI9KyvnDQDsDLo9vw3QRSTIcuFN2CcAowmngsNyr-MIFA_JVAFD3uBCi9z_yO1gTxOh6guxD3UkZvO6T7wX8RGn2bN9sObm6VpObvKwtOXvLBywOIHI0Ztoag0pNVgAPD2nX7V-ZP2tqd5umkHOy2hGn4 May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Domain-Id: None May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Domain-Name: None May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Identity-Status: Confirmed May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Is-Admin-Project: True May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Openstack-Nova-Api-Version: 2.90 May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Project-Domain-Id: default May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Project-Domain-Name: Default May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Project-Id: f3569780f2fe4b24b4109e2eee3c26fe May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Project-Name: admin May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Role: member,admin,reader May 19 12:10:16.850796 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Roles: member,admin,reader May 19 12:10:16.852402 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f3569780f2fe4b24b4109e2eee3c26fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:10:16.852402 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Tenant: admin May 19 12:10:16.852402 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Tenant-Id: f3569780f2fe4b24b4109e2eee3c26fe May 19 12:10:16.852402 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-Tenant-Name: admin May 19 12:10:16.852402 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-User: admin May 19 12:10:16.852402 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-User-Domain-Id: default May 19 12:10:16.852402 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-User-Domain-Name: Default May 19 12:10:16.852402 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-User-Id: 11855e565a88475189d279de9469c271 May 19 12:10:16.852402 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: X-User-Name: admin May 19 12:10:16.852402 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: method: > May 19 12:10:16.852402 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: exception: Flavor 451 could not be found. May 19 12:10:16.852402 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: action_args: {'id': '451'} May 19 12:10:16.852402 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:10:16.852402 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:10:16.853416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 12:10:16.853416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 12:10:16.853416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 12:10:16.853416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 12:10:16.853416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 12:10:16.853416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 12:10:16.853416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 12:10:16.853416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 12:10:16.853416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 12:10:16.853416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:10:16.853416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 12:10:16.853416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 12:10:16.853416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 12:10:16.853416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 19 12:10:16.853416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:10:16.853416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 19 12:10:16.853416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:10:16.853416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:10:16.853416 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:10:16.854628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:10:16.854628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:10:16.854628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:10:16.854628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:10:16.854628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 12:10:16.854628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 12:10:16.854628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 12:10:16.854628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 19 12:10:16.854628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:10:16.854628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 19 12:10:16.854628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:10:16.854628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:10:16.854628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:10:16.854628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:10:16.854628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:10:16.854628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 12:10:16.854628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 19 12:10:16.854628 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-dbedd806-bd2b-43d6-b451-7c25f8a5cf40 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:10:16.855882 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-dbedd806-bd2b-43d6-b451-7c25f8a5cf40 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012947 May 19 12:10:16.855882 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Thu May 19 12:10:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 12:10:17.778803 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-f20211b7-b03c-42f1-b0f8-26e7cb4a98cd admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:17.780054 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-f20211b7-b03c-42f1-b0f8-26e7cb4a98cd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 19 12:10:17.780706 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 19 12:10:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:10:17.980339 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-3b793b06-1b7e-4a30-ac2a-37f7a2f1b19c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:10:18.062046 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-3b793b06-1b7e-4a30-ac2a-37f7a2f1b19c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.141979 May 19 12:10:18.062777 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Thu May 19 12:10:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:10:18.985924 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-f20211b7-b03c-42f1-b0f8-26e7cb4a98cd admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:18.987104 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-f20211b7-b03c-42f1-b0f8-26e7cb4a98cd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 May 19 12:10:18.987487 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 19 12:10:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:10:19.184025 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-1640b5f7-20bb-4932-9211-aaddec05fb6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:10:19.272919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-1640b5f7-20bb-4932-9211-aaddec05fb6d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.143394 May 19 12:10:19.274393 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Thu May 19 12:10:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:10:20.192539 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-f20211b7-b03c-42f1-b0f8-26e7cb4a98cd admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:20.193652 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-f20211b7-b03c-42f1-b0f8-26e7cb4a98cd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 May 19 12:10:20.194048 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 19 12:10:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:10:20.387919 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-3c806442-0a94-4721-89fb-afb28099fcfa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:10:20.499021 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-3c806442-0a94-4721-89fb-afb28099fcfa admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.165889 May 19 12:10:20.499567 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Thu May 19 12:10:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:10:21.406170 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-f20211b7-b03c-42f1-b0f8-26e7cb4a98cd admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:21.407256 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-f20211b7-b03c-42f1-b0f8-26e7cb4a98cd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002481 May 19 12:10:21.407637 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 19 12:10:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:10:21.599095 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-1faf0c3f-a87a-488f-b668-acbae9e3afae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:10:21.683474 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-1faf0c3f-a87a-488f-b668-acbae9e3afae admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.138597 May 19 12:10:21.683978 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Thu May 19 12:10:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:10:22.599743 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-f20211b7-b03c-42f1-b0f8-26e7cb4a98cd admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:22.600799 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-f20211b7-b03c-42f1-b0f8-26e7cb4a98cd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 May 19 12:10:22.601193 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 19 12:10:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:10:22.799886 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-083bb9ff-da10-49e1-ab2d-310d9fd4c6ac admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:10:22.820879 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-083bb9ff-da10-49e1-ab2d-310d9fd4c6ac admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.076061 May 19 12:10:22.821350 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Thu May 19 12:10:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:11:26.278238 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-f20211b7-b03c-42f1-b0f8-26e7cb4a98cd admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:11:26.279975 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-f20211b7-b03c-42f1-b0f8-26e7cb4a98cd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 19 12:11:26.280628 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 19 12:11:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:11:26.287638 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:26.340109 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-11c4fc36-eaa5-48d6-9a1a-d7f29031bd02 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:11:26.359866 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-11c4fc36-eaa5-48d6-9a1a-d7f29031bd02 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073513 May 19 12:11:26.360420 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1291 bytes} [Thu May 19 12:11:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:11:26.380444 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:26.384132 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-67b3eaee-c7f7-4f67-a733-9a2dd26a1bed admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:11:26.392372 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-67b3eaee-c7f7-4f67-a733-9a2dd26a1bed admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013461 May 19 12:11:26.392887 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1282 bytes} [Thu May 19 12:11:26 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:11:26.404967 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-31840a8a-b2b1-49c7-a6f5-317a78adf3ab admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:11:26.413342 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-31840a8a-b2b1-49c7-a6f5-317a78adf3ab admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012744 May 19 12:11:26.413869 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1285 bytes} [Thu May 19 12:11:26 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:11:26.425810 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-308d3a9a-95c2-434a-a743-a760e3c57342 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:11:26.433489 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-308d3a9a-95c2-434a-a743-a760e3c57342 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011421 May 19 12:11:26.433989 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1285 bytes} [Thu May 19 12:11:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:11:26.446429 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-910e01d9-63a8-476c-a6af-53708aa50b81 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:11:26.455424 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-910e01d9-63a8-476c-a6af-53708aa50b81 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012698 May 19 12:11:26.455981 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1282 bytes} [Thu May 19 12:11:26 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:15:38.640284 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-308d3a9a-95c2-434a-a743-a760e3c57342 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:15:38.641504 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-308d3a9a-95c2-434a-a743-a760e3c57342 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002230 May 19 12:15:38.641872 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 19 12:15:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:15:38.800446 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_api:SELECT=6 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:38.913366 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-bdf6189a-04d5-4c0b-9005-bf138e525370 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:15:38.914568 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:15:38.914568 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: warnings.warn(msg) May 19 12:15:38.915775 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-bdf6189a-04d5-4c0b-9005-bf138e525370 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:15:38.916269 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-bdf6189a-04d5-4c0b-9005-bf138e525370 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:15:38.917061 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-bdf6189a-04d5-4c0b-9005-bf138e525370 admin admin] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:15:38.917491 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-bdf6189a-04d5-4c0b-9005-bf138e525370 admin admin] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:15:38.954903 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-bdf6189a-04d5-4c0b-9005-bf138e525370 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.155897 May 19 12:15:38.955477 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 36/70] 10.222.0.23 () {60 vars in 1193 bytes} [Thu May 19 12:15:38 2022] GET /compute/v2.1/os-services => generated 794 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:15:39.863946 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-308d3a9a-95c2-434a-a743-a760e3c57342 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:15:39.864949 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-308d3a9a-95c2-434a-a743-a760e3c57342 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 19 12:15:39.865342 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 19 12:15:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:15:40.060521 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-c8c9a71a-ccd9-47ac-b482-c5e418d35e09 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:15:40.061763 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:15:40.061763 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: warnings.warn(msg) May 19 12:15:40.062978 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-c8c9a71a-ccd9-47ac-b482-c5e418d35e09 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:15:40.063418 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-c8c9a71a-ccd9-47ac-b482-c5e418d35e09 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:15:40.064247 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-c8c9a71a-ccd9-47ac-b482-c5e418d35e09 admin admin] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:15:40.064721 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-c8c9a71a-ccd9-47ac-b482-c5e418d35e09 admin admin] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:15:40.084025 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-c8c9a71a-ccd9-47ac-b482-c5e418d35e09 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.073695 May 19 12:15:40.084508 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 37/72] 10.222.0.23 () {60 vars in 1193 bytes} [Thu May 19 12:15:40 2022] GET /compute/v2.1/os-services => generated 794 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:15:51.421421 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-308d3a9a-95c2-434a-a743-a760e3c57342 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:15:51.422446 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-308d3a9a-95c2-434a-a743-a760e3c57342 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 19 12:15:51.422858 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 36/73] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 19 12:15:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:15:51.567419 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_cell0:SELECT=4 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:51.568174 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_cell1:SELECT=4 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:51.568789 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_api:SELECT=8 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:51.618846 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-1a7b6323-f44a-4cb6-9454-e4315e65c3f1 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:15:51.620084 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:15:51.620084 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: warnings.warn(msg) May 19 12:15:51.621276 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-1a7b6323-f44a-4cb6-9454-e4315e65c3f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:15:51.621725 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-1a7b6323-f44a-4cb6-9454-e4315e65c3f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:15:51.622550 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-1a7b6323-f44a-4cb6-9454-e4315e65c3f1 admin admin] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:15:51.622982 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-1a7b6323-f44a-4cb6-9454-e4315e65c3f1 admin admin] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:15:51.651826 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-1a7b6323-f44a-4cb6-9454-e4315e65c3f1 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.085481 May 19 12:15:51.651826 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 38/74] 10.222.0.23 () {60 vars in 1193 bytes} [Thu May 19 12:15:51 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:15:52.549561 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-308d3a9a-95c2-434a-a743-a760e3c57342 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:15:52.550628 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-308d3a9a-95c2-434a-a743-a760e3c57342 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 19 12:15:52.551022 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 37/75] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 19 12:15:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:15:52.745841 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-a6abc7fb-554f-411f-beab-897976f88109 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:15:52.747039 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:15:52.747039 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: warnings.warn(msg) May 19 12:15:52.748260 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-a6abc7fb-554f-411f-beab-897976f88109 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:15:52.748702 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-a6abc7fb-554f-411f-beab-897976f88109 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:15:52.749491 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-a6abc7fb-554f-411f-beab-897976f88109 admin admin] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:15:52.749920 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-a6abc7fb-554f-411f-beab-897976f88109 admin admin] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:15:52.772222 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-a6abc7fb-554f-411f-beab-897976f88109 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.079626 May 19 12:15:52.772699 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 39/76] 10.222.0.23 () {60 vars in 1193 bytes} [Thu May 19 12:15:52 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:16:54.615086 dv-cinder-804757-28-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 19 12:16:54.616072 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: Thu May 19 12:16:54 2022 - graceful shutdown triggered... May 19 12:16:54.617270 dv-cinder-804757-28-iscsi devstack@n-api.service[103475]: Gracefully killing worker 1 (pid: 103475)... May 19 12:16:54.617758 dv-cinder-804757-28-iscsi devstack@n-api.service[103476]: Gracefully killing worker 2 (pid: 103476)... May 19 12:16:55.616428 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: worker 1 buried after 1 seconds May 19 12:16:55.616428 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: worker 2 buried after 1 seconds May 19 12:16:55.616428 dv-cinder-804757-28-iscsi devstack@n-api.service[103474]: goodbye to uWSGI. May 19 12:16:55.619098 dv-cinder-804757-28-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 19 12:16:55.620008 dv-cinder-804757-28-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 19 12:16:55.623068 dv-cinder-804757-28-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 19 12:16:55.642692 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 12:16:55.663741 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 12:16:55 2022] *** May 19 12:16:55.664166 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 12:16:55.664166 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 12:16:55.664166 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: nodename: dv-cinder-804757-28-iscsi May 19 12:16:55.664166 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: machine: x86_64 May 19 12:16:55.664166 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: clock source: unix May 19 12:16:55.664166 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: pcre jit disabled May 19 12:16:55.665044 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: detected number of CPU cores: 4 May 19 12:16:55.665044 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: current working directory: / May 19 12:16:55.665044 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: detected binary path: /usr/bin/uwsgi-core May 19 12:16:55.665044 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: your processes number limit is 47680 May 19 12:16:55.665044 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: your memory page size is 4096 bytes May 19 12:16:55.665044 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: detected max file descriptor number: 2048 May 19 12:16:55.665044 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: lock engine: pthread robust mutexes May 19 12:16:55.665044 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: thunder lock: enabled May 19 12:16:55.665978 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 12:16:55.665978 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 12:16:55.720703 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: Python main interpreter initialized at 0x562f61fa49c0 May 19 12:16:55.720703 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: python threads support enabled May 19 12:16:55.720703 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: your server socket listen backlog is limited to 100 connections May 19 12:16:55.720703 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: your mercy for graceful operations on workers is 90 seconds May 19 12:16:55.721293 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: mapped 403077 bytes (393 KB) for 2 cores May 19 12:16:55.721293 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: *** Operational MODE: preforking *** May 19 12:16:55.721556 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: *** uWSGI is running in multiple interpreter mode *** May 19 12:16:55.721556 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: spawned uWSGI master process (pid: 117950) May 19 12:16:55.721696 dv-cinder-804757-28-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 19 12:16:55.723318 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: spawned uWSGI worker 1 (pid: 117963, cores: 1) May 19 12:16:55.723318 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: spawned uWSGI worker 2 (pid: 117964, cores: 1) May 19 12:16:55.723318 dv-cinder-804757-28-iscsi devstack@n-api.service[117950]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 12:16:57.051743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 12:16:57.386339 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 12:16:57.915074 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 12:16:57.915074 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: from cryptography.utils import int_from_bytes May 19 12:16:57.915865 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 12:16:57.915865 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: from cryptography.utils import int_from_bytes May 19 12:16:58.138553 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 12:16:58.138553 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: from cryptography.utils import int_from_bytes May 19 12:16:58.138962 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 12:16:58.138962 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: from cryptography.utils import int_from_bytes May 19 12:17:00.723591 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 12:17:00.724778 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 12:17:00.724778 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 12:17:00.724778 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 12:17:00.725268 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 12:17:00.725420 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.725783 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.727128 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.727128 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.727128 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.727645 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.727645 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.728047 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.728285 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.728555 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.728880 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.729222 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804757-28-iscsi {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.729555 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.729874 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.730197 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.730528 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.730839 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.731172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.731494 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.732038 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.733739 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.733739 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.733739 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.733739 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.733739 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.734237 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.734347 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.734663 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.735005 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.735329 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.735744 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804757-28-iscsi {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.736100 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.736416 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.736728 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.737168 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.737504 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.737811 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.738155 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.738487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.738817 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.739131 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.739458 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.739822 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.740142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.740457 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.740778 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.741093 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.741467 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.741767 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.742081 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.742342 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.742846 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.743179 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.743514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.743871 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.744127 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.744386 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.746045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.746045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.746045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.746045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.746045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.746986 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.746986 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.746986 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.747635 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.747635 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.748066 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.748066 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.748519 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.748754 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.749780 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.749780 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.749780 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.750285 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.750447 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.750651 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.750967 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.751298 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.751625 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.752156 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.752474 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.752793 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.753126 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.753479 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.753796 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.754052 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.754365 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.754680 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.755012 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.755331 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.755647 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.756007 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.756319 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.756635 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.756949 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.758629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.758629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.758979 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.759114 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.759438 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.759752 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.760097 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.760435 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.760768 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.761086 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.761403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.761751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.762078 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.762361 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.762679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.762996 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.763329 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.763643 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.764001 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.764336 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.764653 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.764968 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.765297 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.765608 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.765994 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.766352 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.766554 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.766855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.767168 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.767506 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.767859 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.768133 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.768448 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.768766 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.769075 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.769404 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.769735 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.770052 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.770366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.770681 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.771158 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.771359 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.771684 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.772082 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.772436 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.772811 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.773907 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.773907 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.773907 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.773907 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.775205 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.775205 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.775514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.775864 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.776140 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.776655 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.776835 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.777165 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.777453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.777782 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.778101 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.778425 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.778773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.779105 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.779429 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.779809 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.780199 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.780504 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.780843 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.781339 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.781575 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.781808 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.782129 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.782588 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.782935 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.783101 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.783435 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.783755 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.784104 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.784423 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.784742 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.785058 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.785415 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.785742 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.786070 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.786394 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.786723 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.787148 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.787333 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.787664 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.788028 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.788460 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.788971 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.788971 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.789881 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.790044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.790295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.790615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.790964 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.791285 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.791659 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.791951 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.792275 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.792613 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.792915 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.793231 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.793551 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.793887 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.794205 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.794524 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.794857 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.795174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.795489 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.795851 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.796178 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.796495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.796905 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.797132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.797486 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.797792 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.798114 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.798461 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.798808 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.799123 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.799457 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.799855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.800140 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.800457 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.800776 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.801088 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.801402 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.801830 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.802008 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.802330 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.802642 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.803098 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.803256 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.803565 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.804065 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.805314 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.805314 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.805314 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.805902 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.805902 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.806279 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.806487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.806847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.807221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.807496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.807955 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.808206 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.808470 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.808779 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.809104 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.809426 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.809755 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.810075 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.810405 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.810724 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.811059 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.811380 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.811709 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.812156 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.812408 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.812700 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.813048 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.813437 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.813671 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.814002 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.815248 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.815248 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.815248 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.815248 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.816234 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.816234 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.816234 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.816865 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.816865 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.818211 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.818211 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.818211 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.818211 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.826282 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.826282 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.826282 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.826282 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.826282 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.826282 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.826282 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.826282 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.832484 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.832484 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.832484 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.833213 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 12:17:00.834033 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.834033 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.834532 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 12:17:00.834803 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.834803 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.834803 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.837117 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 12:17:00.837411 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.837411 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.837945 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 12:17:00.838228 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.838498 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 12:17:00.838770 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.838770 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.838770 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.839541 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.839832 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.840106 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.840377 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.840377 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.844339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.844650 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.844650 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.845211 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.845500 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.845500 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.846039 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.846372 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.846372 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.846939 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.847263 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.847263 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.847842 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.848409 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.848714 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.848999 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.848999 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.849531 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.849825 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.849825 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.850414 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.850683 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.850683 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.852839 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.853184 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.853444 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804757-28-iscsi {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.853731 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.853731 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.854260 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.860029 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.860029 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.860648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.860961 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.860961 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.861508 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.861864 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.861864 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.862378 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.862702 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.862702 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.863254 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.863513 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.863844 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.864108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.864108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.864720 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.865123 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.865123 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.865659 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.865949 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.865949 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.867117 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.867413 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.867413 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.868002 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.868283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.868283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.869032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.869299 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.869567 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.869821 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.869821 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.870338 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.870593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.870593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.871098 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.871352 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.871352 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.871872 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.872151 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.872151 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.872663 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.872915 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.872915 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.873423 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.873674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.873674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.874167 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.874428 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.874428 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.880023 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804757-28-iscsi {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.880329 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.880329 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.880962 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.881409 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.881409 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.881978 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.882302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.882302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.883887 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.884208 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.884208 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.884747 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.885101 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.885101 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.885722 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.886023 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.886023 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.886594 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.886850 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.887160 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.887443 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.887443 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.888010 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.888310 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.888310 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.888867 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.889162 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.889162 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.889704 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.889973 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.889973 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.890545 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.890821 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.890821 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.891363 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.891633 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.891633 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.892196 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.896021 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.896021 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.896710 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.897043 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.897043 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.898062 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.899282 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.899282 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.899944 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.900224 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.900224 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.900798 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.901057 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.901057 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.901602 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.901858 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.902115 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.902387 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.902387 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.902932 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.903213 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.903213 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.903726 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.904146 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.904146 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.904637 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.904935 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.904935 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.906566 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.906846 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.907118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.907432 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.907432 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.907978 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.908263 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.908530 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.908786 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.908786 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.909305 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.909581 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.909581 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.910096 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.910367 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.910367 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.910848 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.911112 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.911112 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.911591 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.911913 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.911913 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.912394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.912656 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.912656 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.913141 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.913930 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.915774 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.916144 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.916144 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.916647 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.916917 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.916917 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.917409 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.917679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.917679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.918191 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.918441 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.918441 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.918935 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.919212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.919212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.919757 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.920038 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.920038 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.920038 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.920855 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.921164 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.921164 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.921679 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.921988 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.921988 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.922543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.922838 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.922838 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.923351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.923601 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.923601 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.924214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.924502 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.924502 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.925060 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.925337 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.925337 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.936554 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.936924 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.936924 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.937532 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.937838 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.938125 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.938396 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.938396 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.938894 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.939152 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.939152 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.939925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.940229 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.940229 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.940730 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.941026 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.941026 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.941580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.941864 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.941864 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.942378 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.942732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.942732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.943287 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.943536 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.943536 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.944064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.944375 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.944375 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.945937 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.951371 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.951571 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.951721 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.951721 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.952031 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.952169 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.952169 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.952425 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.952548 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.952683 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.952822 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.952822 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.953074 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.953202 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.953202 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.953477 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.953605 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.953605 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.953892 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.954032 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.954164 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.954308 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.954308 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.954569 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.954702 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.954878 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.955044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.955044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.955442 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.955575 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.955575 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.956539 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.956685 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.956813 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.956941 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.956941 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.957174 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.957303 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.957303 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.957549 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.957679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.957679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.957907 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.958053 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.958053 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.958295 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.958415 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.958415 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.958649 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.958787 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.958906 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.959025 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.959025 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.959246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.959378 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.959378 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.959610 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.959751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.959909 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.960032 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.960032 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.960346 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.960514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.960514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.960810 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.960938 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.960938 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.961209 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.961358 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.961358 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.961655 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.961804 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.961804 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.962094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.962260 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.962433 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.962597 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.962597 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.962879 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.963025 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.963025 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.963332 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.963510 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.963510 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.963823 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.963981 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.964154 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.964310 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.964310 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.964587 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.964750 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.964750 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.965053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.965223 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.965223 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.965580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.965724 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.965724 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.966063 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.966233 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.966402 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.966557 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.966718 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.966866 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.966866 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.967045 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.967136 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.967136 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.967308 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.967407 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.967407 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.967577 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.967669 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.967669 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.967857 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.967964 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.967964 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.968148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.968234 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.968317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.968400 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.968400 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.968568 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.968652 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.968652 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.968804 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.968896 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.968896 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.969061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.969144 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.969144 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.969144 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.969144 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.969144 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.969144 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.969579 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.969664 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.969664 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.969837 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.969931 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.969931 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.970101 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.970186 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.970186 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.970361 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:17:00.970455 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.970455 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.970620 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.970714 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.970714 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.970887 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.970973 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.970973 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.971135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.971222 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.971222 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.971400 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.971493 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.971493 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.971656 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.971749 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.971749 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.971956 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.972049 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.972049 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.972202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.972294 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.972294 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.972294 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.972294 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.972294 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.972294 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.972294 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.972782 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.972875 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.972875 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.973027 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.973111 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.973111 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.973583 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.973716 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.973716 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.973898 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.973983 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.973983 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.974146 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.974230 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.974230 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.974385 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.974471 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.974471 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.974646 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.974738 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.974738 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.974908 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.975006 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.975098 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.975184 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.975184 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.975345 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.975436 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.975533 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.975625 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.975625 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.976321 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.976419 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.976419 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.976653 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.976795 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.976795 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.977099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.977269 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.977269 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.977269 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.977543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.977618 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.977618 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.977784 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.977883 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.977883 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.977883 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.978120 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.978215 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.978215 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.978215 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.978533 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.978670 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.978764 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.978858 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.978858 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.979032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.979125 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.979217 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.979302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.979302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.979464 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.979539 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.979539 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.979688 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.979779 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.979779 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.980037 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.980128 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.980219 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.980312 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.980312 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.980481 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.980574 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.980574 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.980727 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.980880 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.980999 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.981121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.981121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.981331 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.981443 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.981561 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.981674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.981674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.981906 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.982019 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.982138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.982250 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.982250 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.982250 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.982250 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.982679 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.982799 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.982799 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.983098 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.983221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.983221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.983469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.983590 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.983590 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.983911 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.984041 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.984041 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.984259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.984371 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.984371 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.984599 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.984734 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.984865 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.984995 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.984995 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.985263 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.985403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.985403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.985650 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.985789 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.985928 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.986068 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.986068 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.986332 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.986469 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.986469 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.986724 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.986868 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.986868 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.986868 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.987229 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.987358 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.987358 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.987358 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.987358 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.987885 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.988018 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.988156 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.988286 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.988286 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.988286 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.988286 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.988793 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.988923 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.988923 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.988923 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.989313 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.989443 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.989443 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.989696 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.989840 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.989972 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.990111 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.990111 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.990366 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.990507 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.990647 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.990786 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.990786 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.991042 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.991173 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.991173 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.991173 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.992274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.992274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.992625 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.992769 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.992769 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.992769 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.993194 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.993332 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.993472 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.993611 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.993611 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.993869 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.994008 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.994008 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.994256 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.994386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.994524 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.994524 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.994524 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.994911 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.995043 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.995173 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.995173 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.995430 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.995561 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.995706 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.995964 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.995964 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.996229 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.996359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.996495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.996495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.996758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.996902 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.997033 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.997033 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.997288 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.997426 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.997564 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.997708 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.997839 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.997967 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.998095 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.998095 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.998341 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.998483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.998483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.998745 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.998884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.999023 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.999167 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.999306 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.999444 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.999581 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.999581 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.999843 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:00.999843 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.000112 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.000248 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.000380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.000516 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.000877 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.001023 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.001338 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.001483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.001785 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.001959 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.002231 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.002539 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.002682 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.003081 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.003323 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.003538 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.003845 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.004066 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.004344 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.004712 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.004930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.005148 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.005479 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.005772 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.006364 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.006545 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.006854 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.007020 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.007857 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.008057 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.008382 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.008605 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.008971 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.009223 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.009539 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.009761 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.009988 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.010324 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.010543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.010911 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.011136 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.011533 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.011691 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.012013 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.012314 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.012467 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.012867 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.013010 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.013315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.013475 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.013782 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.014071 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.014213 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.014613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.014907 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.015043 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.015530 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.015681 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.016352 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.016512 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.016698 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.016840 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.017154 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.017324 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.017658 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.017913 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.018107 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.018479 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.018629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.018945 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.019087 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.019517 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.019666 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.019984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.020191 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.020473 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.020750 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.021056 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.021321 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.021502 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.021871 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.022006 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.022339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.022473 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.022857 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.023602 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.023904 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.024177 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.024400 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.024707 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.024854 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.025175 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.025317 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.025717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.026025 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.026518 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.026665 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.026796 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.027115 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.027250 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.027567 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.027716 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.028036 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.028311 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.028480 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.028871 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.029002 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.029395 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.029539 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.029780 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.030024 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.030222 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.030622 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.030766 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.031144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.031297 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.031526 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.031807 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.031993 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.032385 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.032527 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.032841 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.032977 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.033278 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.033522 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.033716 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.034107 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.034248 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.034564 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.034706 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.035008 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.035211 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.035468 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.035915 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.036078 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.036646 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.036789 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.036930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.037191 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.037332 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.037715 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.037857 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.038153 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.038555 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.039002 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.039242 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.039574 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.039763 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.039960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.040356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.040490 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.040806 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.040949 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.041314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.041468 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.041774 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.042049 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.042221 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.043736 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.043736 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.044056 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.044198 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.044198 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.044449 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.044595 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.044727 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.044857 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.044992 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.045122 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.045395 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.045548 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.045888 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.046164 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.046322 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.046550 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.046930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.047150 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.047377 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.047750 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.047960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.048218 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.048451 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.048659 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.049049 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.049181 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.049512 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.049751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.050237 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.050380 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.050708 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.050942 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.051157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.051516 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.051673 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.052009 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.052145 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.052478 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.052733 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.052941 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.053339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.053479 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.053814 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.054482 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.054789 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.055102 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.055338 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.055710 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.056016 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.056414 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.056568 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.057016 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.057164 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.057463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.057615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.057907 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.058225 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.058359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.058721 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.058855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.059163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.059412 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.059618 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.060037 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.060189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.060479 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.060720 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.060995 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.061308 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.061569 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.061800 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.062122 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.062528 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.062918 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.063301 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.063435 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.063748 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.064045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.064203 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.064627 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.064760 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.065064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.065268 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.065537 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.065851 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.065994 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.066451 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 12:17:01.066596 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.066850 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.067358 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.067766 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.068172 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.068558 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.068942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.069330 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.070668 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.071184 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.071624 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.072040 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.072432 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.072841 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.073227 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.073686 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.074074 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.074473 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.074863 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.075249 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.075633 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.076044 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.076429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.076813 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.077386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.077771 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.078182 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.078570 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.078954 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.079340 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.079728 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.080161 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.080549 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.080962 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.081356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.081750 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.082131 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.082520 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.082905 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.083307 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.083697 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.084121 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.084518 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.084903 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.085326 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.085714 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.086097 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.086541 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.086979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.087582 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.087768 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.088169 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.088567 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.088951 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.089357 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.089746 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.090129 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.090553 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.091108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.091396 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.091687 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.092174 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.092520 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.092913 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.093308 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.093717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.094109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.094502 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.094888 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.095280 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.095669 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.096079 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.096466 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.096994 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.097282 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.097820 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.098017 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.098687 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.099092 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.099498 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.099909 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.100300 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.100692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.101236 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.101626 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.102118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.103092 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.103772 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.104443 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.105122 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.105810 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.106282 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.106682 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.107082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.107480 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.108080 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.108322 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.108712 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.109105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.109497 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.109889 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.110279 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.110851 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.111137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.111470 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.111822 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.116114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.116114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.116114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.116114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.116114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.116114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.116114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.116114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.119077 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.119077 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.119077 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.119077 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.119077 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.119077 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.119077 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.119077 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.120315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.120315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.120315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.120315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.120315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.120315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.121487 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.121487 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.121487 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.122039 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.122039 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.122338 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.122630 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.122940 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.123139 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.123531 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.123894 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.124232 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.124562 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.124883 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.125230 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.125560 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.125890 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.126257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.126670 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.127006 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.127334 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.127670 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.128038 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.128747 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.128747 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.129039 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.129264 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.129578 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.129915 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.130233 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.130554 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.130873 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.131242 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.131501 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.131837 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.133199 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.133199 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.134008 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.134008 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.134008 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.134464 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.134626 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.134951 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.135268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.135585 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.135924 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.136676 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.136676 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.136969 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.137210 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.137559 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.137895 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.138225 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.138921 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.138921 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.139234 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.139651 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.139864 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.140187 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.140500 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.140821 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.141137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.141454 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.141768 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.142085 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.142397 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.142710 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.143144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.143446 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.143666 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.144035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.144355 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.144668 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.144982 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.145295 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.145657 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.145972 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.146319 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.146649 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.146981 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.147321 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.147646 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.148168 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.156379 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.156379 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.156379 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.156379 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.156379 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.156379 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.156379 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.156379 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.157966 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.157966 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.157966 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.157966 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.157966 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.157966 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.157966 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.157966 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.158963 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.158963 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.158963 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.158963 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.158963 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.158963 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.158963 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.158963 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.160482 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.160482 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.160482 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.160482 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.160482 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.160482 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.160482 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.161352 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.161352 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.161352 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.161352 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.161352 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.161352 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.161352 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.161352 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.162330 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.162330 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.162330 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.162330 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.162330 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.162954 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.162954 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.163310 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.164511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.164511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.164511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.165080 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.165244 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.165597 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.165935 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.166269 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.166591 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.166915 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.167251 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.167568 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.167906 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.168225 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.168543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.168856 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.169189 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.169628 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.169817 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.170147 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.170465 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.171020 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.171378 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.171703 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.172089 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.172398 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.172795 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.173039 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.173465 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.173690 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.173990 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.174316 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.174635 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.174949 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.175264 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.175584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.175927 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.176243 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.176563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.176876 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.177272 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.177517 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.177833 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.178144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.178464 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.178784 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.179645 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.184969 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.184969 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.185290 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO dbcounter [None req-4db6c480-61f0-425a-9e21-f7ae08670621 None None] Registered counter for database nova_api May 19 12:17:01.185464 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.185464 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.185464 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.185464 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.185464 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.185464 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.185464 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.185464 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.186532 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.186532 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.186532 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.186532 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.186532 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.186532 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.186532 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.186532 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.188070 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.188070 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.188070 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.188070 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.188070 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.188070 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.189186 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.189186 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.189186 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.189186 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.189715 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.189715 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.189974 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.190376 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.190667 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.190902 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.191237 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.191835 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.191835 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.192317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.192569 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.192838 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.193072 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.193510 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.193774 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.194031 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.194352 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.195718 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.196261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.196528 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.196858 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.197182 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.197650 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.197895 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.198160 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.198495 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.198806 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.199659 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.199988 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.200319 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.200733 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.200977 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.203848 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.203848 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.204176 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.204279 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.204578 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.205023 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.205305 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.205687 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.206007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.206338 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.206639 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_db.sqlalchemy.engines [None req-4db6c480-61f0-425a-9e21-f7ae08670621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117964) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:17:01.206900 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.207148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.207434 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.207718 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.208025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.208267 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.208570 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.208965 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.209336 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.209723 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.209971 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.210822 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.211243 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.211679 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.212416 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.212416 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.212973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.212973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.219219 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.219219 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.219219 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.219219 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.219219 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.219219 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.219219 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.220909 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writer thread running {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:17:01.221160 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.221160 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.221160 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.221160 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.221160 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.221160 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.221160 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.221160 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.222930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.222930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.222930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.222930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.222930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.222930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.222930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.222930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.225555 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.225555 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.225555 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.225555 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.225555 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.225555 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.225555 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.225555 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.229114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.229114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.229114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.229114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.229114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.229114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.229114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.229114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.231035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.231035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.231035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.231035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.231035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.231035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.231035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.231035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.232841 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.232841 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.232841 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.232841 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.232841 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.232841 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:17:01.232841 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 12:17:01.282465 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.context [None req-4db6c480-61f0-425a-9e21-f7ae08670621 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),792a11ae-0eb2-4d8f-8039-aee2984c4d9a(cell1) {{(pid=117964) load_cells /opt/stack/nova/nova/context.py:464}} May 19 12:17:01.287286 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4db6c480-61f0-425a-9e21-f7ae08670621 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:17:01.290976 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4db6c480-61f0-425a-9e21-f7ae08670621 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:17:01.291840 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4db6c480-61f0-425a-9e21-f7ae08670621 None None] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:17:01.293577 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO dbcounter [None req-a67003e3-3e28-45f5-981c-a24a52bc209b None None] Registered counter for database nova_api May 19 12:17:01.293970 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4db6c480-61f0-425a-9e21-f7ae08670621 None None] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:17:01.296039 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO dbcounter [None req-4db6c480-61f0-425a-9e21-f7ae08670621 None None] Registered counter for database nova_cell0 May 19 12:17:01.300345 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO dbcounter [None req-4db6c480-61f0-425a-9e21-f7ae08670621 None None] Registered counter for database nova_cell1 May 19 12:17:01.310747 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_db.sqlalchemy.engines [None req-4db6c480-61f0-425a-9e21-f7ae08670621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117964) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:17:01.316357 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_db.sqlalchemy.engines [None req-4db6c480-61f0-425a-9e21-f7ae08670621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117964) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:17:01.320299 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writer thread running {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:17:01.321443 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_db.sqlalchemy.engines [None req-a67003e3-3e28-45f5-981c-a24a52bc209b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:17:01.331309 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writer thread running {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:17:01.438331 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.context [None req-a67003e3-3e28-45f5-981c-a24a52bc209b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),792a11ae-0eb2-4d8f-8039-aee2984c4d9a(cell1) {{(pid=117963) load_cells /opt/stack/nova/nova/context.py:464}} May 19 12:17:01.448241 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a67003e3-3e28-45f5-981c-a24a52bc209b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:17:01.451874 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a67003e3-3e28-45f5-981c-a24a52bc209b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:17:01.453690 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a67003e3-3e28-45f5-981c-a24a52bc209b None None] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:17:01.457367 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a67003e3-3e28-45f5-981c-a24a52bc209b None None] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:17:01.461103 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO dbcounter [None req-a67003e3-3e28-45f5-981c-a24a52bc209b None None] Registered counter for database nova_cell0 May 19 12:17:01.468541 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO dbcounter [None req-a67003e3-3e28-45f5-981c-a24a52bc209b None None] Registered counter for database nova_cell1 May 19 12:17:01.479221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writer thread running {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:17:01.483636 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_db.sqlalchemy.engines [None req-a67003e3-3e28-45f5-981c-a24a52bc209b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:17:01.485235 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_db.sqlalchemy.engines [None req-a67003e3-3e28-45f5-981c-a24a52bc209b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:17:01.490425 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO dbcounter [None req-4db6c480-61f0-425a-9e21-f7ae08670621 None None] Registered counter for database nova_cell0 May 19 12:17:01.497568 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writer thread running {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:17:01.498806 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_db.sqlalchemy.engines [None req-4db6c480-61f0-425a-9e21-f7ae08670621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117964) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:17:01.499728 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writer thread running {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:17:01.503690 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writer thread running {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:17:01.757345 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO dbcounter [None req-a67003e3-3e28-45f5-981c-a24a52bc209b None None] Registered counter for database nova_cell0 May 19 12:17:01.765137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_db.sqlalchemy.engines [None req-a67003e3-3e28-45f5-981c-a24a52bc209b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:17:01.770834 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writer thread running {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:17:01.848879 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: WARNING keystonemiddleware.auth_token [None req-4db6c480-61f0-425a-9e21-f7ae08670621 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 12:17:01.857891 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: WARNING keystonemiddleware.auth_token [None req-4db6c480-61f0-425a-9e21-f7ae08670621 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 12:17:02.133309 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: WARNING keystonemiddleware.auth_token [None req-a67003e3-3e28-45f5-981c-a24a52bc209b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 12:17:02.141366 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: WARNING keystonemiddleware.auth_token [None req-a67003e3-3e28-45f5-981c-a24a52bc209b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 12:17:02.237358 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: WARNING keystonemiddleware.auth_token [None req-4db6c480-61f0-425a-9e21-f7ae08670621 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 12:17:02.244682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: WARNING keystonemiddleware.auth_token [None req-4db6c480-61f0-425a-9e21-f7ae08670621 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 12:17:02.250809 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x562f61fa49c0 pid: 117964 (default app) May 19 12:17:02.498910 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: WARNING keystonemiddleware.auth_token [None req-a67003e3-3e28-45f5-981c-a24a52bc209b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 12:17:02.505446 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: WARNING keystonemiddleware.auth_token [None req-a67003e3-3e28-45f5-981c-a24a52bc209b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 12:17:02.511443 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x562f61fa49c0 pid: 117963 (default app) May 19 12:17:47.756891 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=3 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:47.761694 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=3 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:47.761694 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=3 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:47.761694 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=3 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:49.609754 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b3058ba1-8ed5-47e9-b6c3-63ea9fc253b9 tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] Action: 'create', calling method: .version_select at 0x7f3b9f845430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-782672081", "metadata": {"Type": "work"}}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b3058ba1-8ed5-47e9-b6c3-63ea9fc253b9 tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] Request method failure captured: May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 121 May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjVr8L8kco0YUUnLHyo_TSVTAikWMs_gsHUYVfcet3ehUMOb2Ci09CkGJO-JkyXx38PKPxeperNy9KiYhFP58LCh27kSICaJF3xlTNx9PMAWCvPjHGTIuzRVhOu9MlHQBUrHN6flXH-bGcFTKqkxnV-bsYUxh-L9BzkwlDtCas_QUGg May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 5a530cf15e11460b898957828f7d858e May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-VolumesNegativeTest-2062694481 May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:17:49.632884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:17:49.634467 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5a530cf15e11460b898957828f7d858e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a530cf15e11460b898957828f7d858e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5a530cf15e11460b898957828f7d858e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a530cf15e11460b898957828f7d858e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:17:49.634467 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-VolumesNegativeTest-2062694481 May 19 12:17:49.634467 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 5a530cf15e11460b898957828f7d858e May 19 12:17:49.634467 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-VolumesNegativeTest-2062694481 May 19 12:17:49.634467 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-VolumesNegativeTest-2062694481-project May 19 12:17:49.634467 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:17:49.634467 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:17:49.634467 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: ec3d521695a64c62a6a2844594ac420e May 19 12:17:49.634467 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-VolumesNegativeTest-2062694481-project May 19 12:17:49.634467 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: May 19 12:17:49.634467 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-782672081", "metadata": {"Type": "work"}}} May 19 12:17:49.634467 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: May 19 12:17:49.634467 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-782672081', 'metadata': {'Type': 'work'}}}} May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise error May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi '#$%' May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:17:49.635306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:17:49.638957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:17:49.638957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:17:49.638957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:17:49.638957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:17:49.638957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 12:17:49.638957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 12:17:49.638957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 12:17:49.638957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 12:17:49.638957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 12:17:49.638957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 12:17:49.638957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 12:17:49.638957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:17:49.638957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:17:49.638957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:17:49.638957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:49.638957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:17:49.638957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:17:49.638957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 12:17:49.638957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 12:17:49.641630 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 12:17:49.641630 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:17:49.642916 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b3058ba1-8ed5-47e9-b6c3-63ea9fc253b9 tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:17:49.644195 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b3058ba1-8ed5-47e9-b6c3-63ea9fc253b9 tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.898075 May 19 12:17:49.650729 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1155 bytes} [Thu May 19 12:17:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1906 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 12:17:49.682048 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:49.685132 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:49.691682 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:49.696686 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:50.204611 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ca95705b-0f70-4483-9ff5-7dc1595d6e2a tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] Action: 'create', calling method: .version_select at 0x7f3b9f8da160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1503360480", "metadata": {"Type": "work"}}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ca95705b-0f70-4483-9ff5-7dc1595d6e2a tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] Request method failure captured: May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 120 May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjVr8L8kco0YUUnLHyo_TSVTAikWMs_gsHUYVfcet3ehUMOb2Ci09CkGJO-JkyXx38PKPxeperNy9KiYhFP58LCh27kSICaJF3xlTNx9PMAWCvPjHGTIuzRVhOu9MlHQBUrHN6flXH-bGcFTKqkxnV-bsYUxh-L9BzkwlDtCas_QUGg May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 5a530cf15e11460b898957828f7d858e May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-VolumesNegativeTest-2062694481 May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:17:50.220590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:17:50.225246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5a530cf15e11460b898957828f7d858e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a530cf15e11460b898957828f7d858e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5a530cf15e11460b898957828f7d858e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a530cf15e11460b898957828f7d858e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:17:50.225246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-VolumesNegativeTest-2062694481 May 19 12:17:50.225246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 5a530cf15e11460b898957828f7d858e May 19 12:17:50.225246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-VolumesNegativeTest-2062694481 May 19 12:17:50.225246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-VolumesNegativeTest-2062694481-project May 19 12:17:50.225246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:17:50.225246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:17:50.225246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: ec3d521695a64c62a6a2844594ac420e May 19 12:17:50.225246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-VolumesNegativeTest-2062694481-project May 19 12:17:50.225246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: May 19 12:17:50.225246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1503360480", "metadata": {"Type": "work"}}} May 19 12:17:50.225246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: May 19 12:17:50.225246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1503360480', 'metadata': {'Type': 'work'}}}} May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise error May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi '0' May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:17:50.228743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:17:50.237142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:17:50.237142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:17:50.237142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:17:50.237142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:17:50.237142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 12:17:50.237142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 12:17:50.237142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 12:17:50.237142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 12:17:50.237142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 12:17:50.237142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 12:17:50.237142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 12:17:50.237142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:50.237142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:17:50.237142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:50.237142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:50.237142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:17:50.237142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:17:50.237142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 12:17:50.237142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 12:17:50.242170 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 12:17:50.242170 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:50.244824 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ca95705b-0f70-4483-9ff5-7dc1595d6e2a tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:17:50.253797 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ca95705b-0f70-4483-9ff5-7dc1595d6e2a tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.597150 May 19 12:17:50.264264 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 1/2] 10.222.0.23 () {60 vars in 1155 bytes} [Thu May 19 12:17:49 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 607 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 19 12:17:50.268764 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-542cf93b-94f2-467b-942b-f1d60642492a tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] Action: 'create', calling method: .version_select at 0x7f3b9f868790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-440028443", "metadata": {"Type": "work"}}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-542cf93b-94f2-467b-942b-f1d60642492a tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] Request method failure captured: May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 118 May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjVr8L8kco0YUUnLHyo_TSVTAikWMs_gsHUYVfcet3ehUMOb2Ci09CkGJO-JkyXx38PKPxeperNy9KiYhFP58LCh27kSICaJF3xlTNx9PMAWCvPjHGTIuzRVhOu9MlHQBUrHN6flXH-bGcFTKqkxnV-bsYUxh-L9BzkwlDtCas_QUGg May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 5a530cf15e11460b898957828f7d858e May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-VolumesNegativeTest-2062694481 May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:17:50.271487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:17:50.275045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5a530cf15e11460b898957828f7d858e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a530cf15e11460b898957828f7d858e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5a530cf15e11460b898957828f7d858e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a530cf15e11460b898957828f7d858e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:17:50.275045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-VolumesNegativeTest-2062694481 May 19 12:17:50.275045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 5a530cf15e11460b898957828f7d858e May 19 12:17:50.275045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-VolumesNegativeTest-2062694481 May 19 12:17:50.275045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-VolumesNegativeTest-2062694481-project May 19 12:17:50.275045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:17:50.275045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:17:50.275045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: ec3d521695a64c62a6a2844594ac420e May 19 12:17:50.275045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-VolumesNegativeTest-2062694481-project May 19 12:17:50.275045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: May 19 12:17:50.275045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-440028443", "metadata": {"Type": "work"}}} May 19 12:17:50.275045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: May 19 12:17:50.275045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-440028443', 'metadata': {'Type': 'work'}}}} May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise error May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi '' May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:17:50.277163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:17:50.289232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:17:50.289232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:17:50.289232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:17:50.289232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:17:50.289232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 12:17:50.289232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 12:17:50.289232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 12:17:50.289232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 12:17:50.289232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 12:17:50.289232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 12:17:50.289232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 12:17:50.289232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:17:50.289232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:17:50.289232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:17:50.289232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:50.289232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:17:50.289232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:17:50.289232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 12:17:50.289232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 12:17:50.292440 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 12:17:50.292440 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:17:50.292440 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-542cf93b-94f2-467b-942b-f1d60642492a tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:17:50.292440 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-542cf93b-94f2-467b-942b-f1d60642492a tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012124 May 19 12:17:50.292440 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1155 bytes} [Thu May 19 12:17:50 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 12:17:50.304574 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-75fcbe93-6621-41fa-a327-6af5988f8a79 tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] Calling method '.version_select at 0x7f3ba00bc790>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:17:51.844954 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9a4116cc-ba9d-465f-a7ec-f6f5212cd5de tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-626309599", "imageRef": "962252c6-9c2c-4b81-bdb7-f6d317bada3b", "flavorRef": "452", "networks": [{"uuid": "5ac03e57-985e-43a7-b44d-c5e798d66059"}]}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:17:51.983642 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-75fcbe93-6621-41fa-a327-6af5988f8a79 tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] HTTP exception thrown: Volume tempest-invalid-600730206 could not be found. May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-75fcbe93-6621-41fa-a327-6af5988f8a79 tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] Request method failure captured: May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-600730206 HTTP/1.1 May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjVr8L8kco0YUUnLHyo_TSVTAikWMs_gsHUYVfcet3ehUMOb2Ci09CkGJO-JkyXx38PKPxeperNy9KiYhFP58LCh27kSICaJF3xlTNx9PMAWCvPjHGTIuzRVhOu9MlHQBUrHN6flXH-bGcFTKqkxnV-bsYUxh-L9BzkwlDtCas_QUGg May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 5a530cf15e11460b898957828f7d858e May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-VolumesNegativeTest-2062694481 May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:17:51.989082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:17:51.990085 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5a530cf15e11460b898957828f7d858e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a530cf15e11460b898957828f7d858e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5a530cf15e11460b898957828f7d858e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a530cf15e11460b898957828f7d858e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:17:51.990085 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-VolumesNegativeTest-2062694481 May 19 12:17:51.990085 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 5a530cf15e11460b898957828f7d858e May 19 12:17:51.990085 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-VolumesNegativeTest-2062694481 May 19 12:17:51.990085 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-VolumesNegativeTest-2062694481-project May 19 12:17:51.990085 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:17:51.990085 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:17:51.990085 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: ec3d521695a64c62a6a2844594ac420e May 19 12:17:51.990085 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-VolumesNegativeTest-2062694481-project May 19 12:17:51.990085 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: May 19 12:17:51.990085 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Volume tempest-invalid-600730206 could not be found. May 19 12:17:51.990085 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': 'tempest-invalid-600730206'} May 19 12:17:51.990085 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:17:51.990661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:51.990661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:17:51.990661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:17:51.990661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 12:17:51.990661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 12:17:51.990661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 12:17:51.990661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 12:17:51.990661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 12:17:51.990661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 12:17:51.990661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 12:17:51.990661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 12:17:51.990661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:17:51.990661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:17:51.990661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:17:51.990661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:17:51.990661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-600730206 could not be found. (HTTP 404) (Request-ID: req-6d39568b-6f74-47be-9284-4e46115d93a5) May 19 12:17:51.990661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:51.990661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:17:51.990661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:51.991551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:51.991551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 12:17:51.991551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 12:17:51.991551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 12:17:51.991551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 12:17:51.991551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 12:17:51.991551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 12:17:51.991551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 12:17:51.991551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 12:17:51.991551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:17:51.991551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:17:51.991551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 12:17:51.991551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 12:17:51.991551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 12:17:51.991551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 12:17:51.991551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 12:17:51.991551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 12:17:51.991551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 12:17:51.991551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-600730206 could not be found. May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:17:51.993228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-600730206 could not be found. May 19 12:17:51.994167 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:51.994167 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:17:51.994167 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:51.994167 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:51.994167 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:17:51.994167 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:17:51.994167 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:17:51.994167 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:17:51.994167 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-600730206 could not be found. May 19 12:17:51.994167 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:51.996746 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-75fcbe93-6621-41fa-a327-6af5988f8a79 tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] Returning 404 to user: Volume tempest-invalid-600730206 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:17:51.998075 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-75fcbe93-6621-41fa-a327-6af5988f8a79 tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-600730206" status: 404 len: 98 microversion: 2.1 time: 1.706209 May 19 12:17:51.999866 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1214 bytes} [Thu May 19 12:17:50 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-600730206 => generated 98 bytes in 1708 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 12:17:52.011889 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a146e977-7725-4c36-a9f7-c64c8752133d tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004798 May 19 12:17:52.016820 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 3/5] 10.222.0.23 () {58 vars in 1139 bytes} [Thu May 19 12:17:52 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 19 12:17:52.031151 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-93a9b27c-4e05-4afd-b271-a56263820d46 tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004293 May 19 12:17:52.033707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 4/6] 10.222.0.23 () {58 vars in 1136 bytes} [Thu May 19 12:17:52 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 12:17:52.046063 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-93dfafa1-8af3-499f-beb1-46844a1d9ea5 tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] Calling method '.version_select at 0x7f3b9f6e7430>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:17:52.084434 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-93dfafa1-8af3-499f-beb1-46844a1d9ea5 tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] HTTP exception thrown: Volume 859d00fc-3c18-4ae1-8272-bf369448791c could not be found. May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-93dfafa1-8af3-499f-beb1-46844a1d9ea5 tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] Request method failure captured: May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: DELETE /compute/v2.1/os-volumes/859d00fc-3c18-4ae1-8272-bf369448791c HTTP/1.1 May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjVr8L8kco0YUUnLHyo_TSVTAikWMs_gsHUYVfcet3ehUMOb2Ci09CkGJO-JkyXx38PKPxeperNy9KiYhFP58LCh27kSICaJF3xlTNx9PMAWCvPjHGTIuzRVhOu9MlHQBUrHN6flXH-bGcFTKqkxnV-bsYUxh-L9BzkwlDtCas_QUGg May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 5a530cf15e11460b898957828f7d858e May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-VolumesNegativeTest-2062694481 May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:17:52.087445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:17:52.088615 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5a530cf15e11460b898957828f7d858e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a530cf15e11460b898957828f7d858e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5a530cf15e11460b898957828f7d858e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a530cf15e11460b898957828f7d858e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:17:52.088615 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-VolumesNegativeTest-2062694481 May 19 12:17:52.088615 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 5a530cf15e11460b898957828f7d858e May 19 12:17:52.088615 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-VolumesNegativeTest-2062694481 May 19 12:17:52.088615 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-VolumesNegativeTest-2062694481-project May 19 12:17:52.088615 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:17:52.088615 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:17:52.088615 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: ec3d521695a64c62a6a2844594ac420e May 19 12:17:52.088615 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-VolumesNegativeTest-2062694481-project May 19 12:17:52.088615 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: May 19 12:17:52.088615 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Volume 859d00fc-3c18-4ae1-8272-bf369448791c could not be found. May 19 12:17:52.088615 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': '859d00fc-3c18-4ae1-8272-bf369448791c'} May 19 12:17:52.088615 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:17:52.089220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:52.089220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:17:52.089220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:17:52.089220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 12:17:52.089220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 12:17:52.089220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 12:17:52.089220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 12:17:52.089220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 12:17:52.089220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 12:17:52.089220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 12:17:52.089220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 12:17:52.089220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:17:52.089220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:17:52.089220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:17:52.089220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:17:52.089220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 859d00fc-3c18-4ae1-8272-bf369448791c could not be found. (HTTP 404) (Request-ID: req-7193fe65-d3d1-4b3f-80dc-b6f9cf020dca) May 19 12:17:52.089220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:52.089220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:17:52.089220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:52.090057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:52.090057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 12:17:52.090057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 12:17:52.090057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 12:17:52.090057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 12:17:52.090057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 12:17:52.090057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 12:17:52.090057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 12:17:52.090057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 12:17:52.090057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:17:52.090057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:17:52.090057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 12:17:52.090057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 12:17:52.090057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 12:17:52.090057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 12:17:52.090057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 12:17:52.090057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 12:17:52.090057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 12:17:52.090057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 12:17:52.090970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:17:52.090970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:17:52.090970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:17:52.090970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:17:52.090970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 859d00fc-3c18-4ae1-8272-bf369448791c could not be found. May 19 12:17:52.090970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:52.090970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:17:52.090970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:52.090970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:52.090970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:17:52.090970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:17:52.090970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:17:52.090970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:17:52.090970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:17:52.090970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:17:52.090970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:17:52.090970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:17:52.090970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 12:17:52.090970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:17:52.094260 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 859d00fc-3c18-4ae1-8272-bf369448791c could not be found. May 19 12:17:52.094260 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:52.094260 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:17:52.094260 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:52.094260 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:52.094260 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:17:52.094260 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:17:52.094260 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:17:52.094260 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:17:52.094260 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 859d00fc-3c18-4ae1-8272-bf369448791c could not be found. May 19 12:17:52.094260 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:52.096593 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-93dfafa1-8af3-499f-beb1-46844a1d9ea5 tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] Returning 404 to user: Volume 859d00fc-3c18-4ae1-8272-bf369448791c could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:17:52.097712 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-93dfafa1-8af3-499f-beb1-46844a1d9ea5 tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/859d00fc-3c18-4ae1-8272-bf369448791c" status: 404 len: 109 microversion: 2.1 time: 0.055897 May 19 12:17:52.098791 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 5/7] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 19 12:17:52 2022] DELETE /compute/v2.1/os-volumes/859d00fc-3c18-4ae1-8272-bf369448791c => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:17:52.111502 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7d3d13ac-7d4b-4094-aaf4-7da89b21104e tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] Calling method '.version_select at 0x7f3b9f739d30>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:17:52.159855 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-7d3d13ac-7d4b-4094-aaf4-7da89b21104e tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] HTTP exception thrown: Volume d5f0ed45-f608-431f-a567-91aee411f05c could not be found. May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7d3d13ac-7d4b-4094-aaf4-7da89b21104e tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] Request method failure captured: May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/os-volumes/d5f0ed45-f608-431f-a567-91aee411f05c HTTP/1.1 May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjVr8L8kco0YUUnLHyo_TSVTAikWMs_gsHUYVfcet3ehUMOb2Ci09CkGJO-JkyXx38PKPxeperNy9KiYhFP58LCh27kSICaJF3xlTNx9PMAWCvPjHGTIuzRVhOu9MlHQBUrHN6flXH-bGcFTKqkxnV-bsYUxh-L9BzkwlDtCas_QUGg May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 5a530cf15e11460b898957828f7d858e May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-VolumesNegativeTest-2062694481 May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:17:52.162386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:17:52.163711 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5a530cf15e11460b898957828f7d858e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a530cf15e11460b898957828f7d858e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5a530cf15e11460b898957828f7d858e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a530cf15e11460b898957828f7d858e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:17:52.163711 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-VolumesNegativeTest-2062694481 May 19 12:17:52.163711 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 5a530cf15e11460b898957828f7d858e May 19 12:17:52.163711 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-VolumesNegativeTest-2062694481 May 19 12:17:52.163711 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-VolumesNegativeTest-2062694481-project May 19 12:17:52.163711 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:17:52.163711 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:17:52.163711 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: ec3d521695a64c62a6a2844594ac420e May 19 12:17:52.163711 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-VolumesNegativeTest-2062694481-project May 19 12:17:52.163711 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: May 19 12:17:52.163711 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Volume d5f0ed45-f608-431f-a567-91aee411f05c could not be found. May 19 12:17:52.163711 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': 'd5f0ed45-f608-431f-a567-91aee411f05c'} May 19 12:17:52.163711 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:17:52.164333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:52.164333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:17:52.164333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:17:52.164333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 12:17:52.164333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 12:17:52.164333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 12:17:52.164333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 12:17:52.164333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:17:52.164333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:17:52.164333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:17:52.164333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:17:52.164333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:17:52.164333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:17:52.164333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:17:52.164333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:17:52.164333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d5f0ed45-f608-431f-a567-91aee411f05c could not be found. (HTTP 404) (Request-ID: req-cd8e99ca-c989-47b3-9fa4-79226f075713) May 19 12:17:52.164333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:52.164333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:17:52.164333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:52.165299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:52.165299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 12:17:52.165299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 12:17:52.165299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 12:17:52.165299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 12:17:52.165299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 12:17:52.165299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 12:17:52.165299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 12:17:52.165299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 12:17:52.165299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:17:52.165299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:17:52.165299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 12:17:52.165299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 12:17:52.165299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 12:17:52.165299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 12:17:52.165299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:17:52.165299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:17:52.165299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:17:52.165299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:17:52.166148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:17:52.166148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:17:52.166148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:17:52.166148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:17:52.166148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d5f0ed45-f608-431f-a567-91aee411f05c could not be found. May 19 12:17:52.166148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:52.166148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:17:52.166148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:52.166148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:52.166148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:17:52.166148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:17:52.166148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:17:52.166148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:17:52.166148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:17:52.166148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:17:52.166148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:17:52.166148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:17:52.166148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 12:17:52.166148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:17:52.166996 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d5f0ed45-f608-431f-a567-91aee411f05c could not be found. May 19 12:17:52.166996 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:52.166996 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:17:52.166996 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:52.166996 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:17:52.166996 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:17:52.166996 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:17:52.166996 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:17:52.166996 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:17:52.166996 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d5f0ed45-f608-431f-a567-91aee411f05c could not be found. May 19 12:17:52.166996 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:17:52.169219 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7d3d13ac-7d4b-4094-aaf4-7da89b21104e tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] Returning 404 to user: Volume d5f0ed45-f608-431f-a567-91aee411f05c could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:17:52.170776 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7d3d13ac-7d4b-4094-aaf4-7da89b21104e tempest-VolumesNegativeTest-2062694481 tempest-VolumesNegativeTest-2062694481-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d5f0ed45-f608-431f-a567-91aee411f05c" status: 404 len: 109 microversion: 2.1 time: 0.064053 May 19 12:17:52.171971 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 6/8] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 19 12:17:52 2022] GET /compute/v2.1/os-volumes/d5f0ed45-f608-431f-a567-91aee411f05c => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:17:52.548707 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.network.neutron [None req-9a4116cc-ba9d-465f-a7ec-f6f5212cd5de tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] validate_networks() for [('5ac03e57-985e-43a7-b44d-c5e798d66059', None, None, None, None, None)] {{(pid=117964) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:17:54.097204 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-db13210c-e38e-4576-bbec-c52704352c93 tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] Calling method '.version_select at 0x7f3b9f9441f0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:17:54.392600 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-db13210c-e38e-4576-bbec-c52704352c93 tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/319e347e-5bbf-4c10-9b8e-7c2e1af0a51d" status: 200 len: 350 microversion: 2.1 time: 0.300575 May 19 12:17:54.393171 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 7/9] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 19 12:17:54 2022] GET /compute/v2.1/os-volumes/319e347e-5bbf-4c10-9b8e-7c2e1af0a51d => generated 350 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:17:55.861598 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-9a4116cc-ba9d-465f-a7ec-f6f5212cd5de tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Flavor limits 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:17:55.862162 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-9a4116cc-ba9d-465f-a7ec-f6f5212cd5de tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Image limits 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:17:55.862479 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-9a4116cc-ba9d-465f-a7ec-f6f5212cd5de tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Flavor pref 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:17:55.862888 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-9a4116cc-ba9d-465f-a7ec-f6f5212cd5de tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Image pref 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:17:55.868915 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-9a4116cc-ba9d-465f-a7ec-f6f5212cd5de tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:17:55.891799 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9a4116cc-ba9d-465f-a7ec-f6f5212cd5de tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:17:55.892249 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9a4116cc-ba9d-465f-a7ec-f6f5212cd5de tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:17:55.895435 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9a4116cc-ba9d-465f-a7ec-f6f5212cd5de tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:17:55.898314 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9a4116cc-ba9d-465f-a7ec-f6f5212cd5de tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:17:55.954160 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-9a4116cc-ba9d-465f-a7ec-f6f5212cd5de tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Getting quotas for project de8f3490bba84ff38b5940fe768ede25. Resources: {'instances', 'ram', 'cores'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:17:55.970627 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-9a4116cc-ba9d-465f-a7ec-f6f5212cd5de tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Getting quotas for user 9e66a142d53340bb8bc4a0a9a9f48d59 and project de8f3490bba84ff38b5940fe768ede25. Resources: {'instances', 'ram', 'cores'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:17:55.997506 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9a4116cc-ba9d-465f-a7ec-f6f5212cd5de tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Going to run 1 instances... {{(pid=117964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:17:56.002956 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9a4116cc-ba9d-465f-a7ec-f6f5212cd5de tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962252c6-9c2c-4b81-bdb7-f6d317bada3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:17:56.254994 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9a4116cc-ba9d-465f-a7ec-f6f5212cd5de tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.809903 May 19 12:17:56.255659 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 3/10] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:17:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 4811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 12:17:56.272173 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6d3d1d08-f1ca-4af5-8699-8869d02b640f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:17:56.273922 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6d3d1d08-f1ca-4af5-8699-8869d02b640f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:17:56.843695 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6d3d1d08-f1ca-4af5-8699-8869d02b640f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:17:56.929684 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6d3d1d08-f1ca-4af5-8699-8869d02b640f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1214 microversion: 2.1 time: 0.660777 May 19 12:17:56.930659 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 8/11] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:17:56 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1214 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:17:57.930121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-7253c154-5f46-4724-ac63-476b4c540ecf tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] Calling method '.version_select at 0x7f3b9f670e50>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:17:57.952473 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b8968404-147a-4689-a60b-d8a4bf959377 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:17:57.966126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b8968404-147a-4689-a60b-d8a4bf959377 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:17:58.129185 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-7253c154-5f46-4724-ac63-476b4c540ecf tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/272cf3b9-5fc1-4d29-a262-c51881960da0" status: 200 len: 350 microversion: 2.1 time: 0.208115 May 19 12:17:58.130830 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 4/12] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 19 12:17:57 2022] GET /compute/v2.1/os-volumes/272cf3b9-5fc1-4d29-a262-c51881960da0 => generated 350 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:17:58.188364 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b8968404-147a-4689-a60b-d8a4bf959377 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:17:58.202509 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b8968404-147a-4689-a60b-d8a4bf959377 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1214 microversion: 2.1 time: 0.257919 May 19 12:17:58.222818 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 9/13] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:17:57 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1214 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:17:59.234709 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-aa375419-b1ef-4b97-81cb-afc6b9cc96a4 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:17:59.237061 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-aa375419-b1ef-4b97-81cb-afc6b9cc96a4 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:17:59.327241 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-aa375419-b1ef-4b97-81cb-afc6b9cc96a4 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:17:59.377299 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-aa375419-b1ef-4b97-81cb-afc6b9cc96a4 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1214 microversion: 2.1 time: 0.149447 May 19 12:17:59.383455 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 5/14] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:17:59 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:00.410210 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1ea6092b-7027-4fb1-b1dc-86f6408dbc36 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:00.412992 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1ea6092b-7027-4fb1-b1dc-86f6408dbc36 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:00.432815 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1ea6092b-7027-4fb1-b1dc-86f6408dbc36 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:00.433294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1ea6092b-7027-4fb1-b1dc-86f6408dbc36 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:00.434122 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1ea6092b-7027-4fb1-b1dc-86f6408dbc36 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:00.434567 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1ea6092b-7027-4fb1-b1dc-86f6408dbc36 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:00.813821 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1ea6092b-7027-4fb1-b1dc-86f6408dbc36 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:00.838890 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1ea6092b-7027-4fb1-b1dc-86f6408dbc36 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1218 microversion: 2.1 time: 0.434930 May 19 12:18:00.842108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 10/15] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:00 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1218 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:01.062992 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-73d95b02-4c33-4d86-bfd0-18afa2ebc6ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-661649789", "imageRef": "962252c6-9c2c-4b81-bdb7-f6d317bada3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:18:01.204762 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.network.neutron [None req-73d95b02-4c33-4d86-bfd0-18afa2ebc6ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] validate_networks() for [('e3809f96-195f-4c7b-acab-0be138088685', None, None, None, None, None)] {{(pid=117964) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:18:01.718971 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1b5b9b3b-4567-4c52-b363-8275ed2f183b tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] Calling method '.version_select at 0x7f3b9f6313a0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:01.829194 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1b5b9b3b-4567-4c52-b363-8275ed2f183b tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/760e453d-ce54-44e3-9e75-2ad11c7e01dc" status: 200 len: 351 microversion: 2.1 time: 0.114439 May 19 12:18:01.830952 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 11/16] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 19 12:18:01 2022] GET /compute/v2.1/os-volumes/760e453d-ce54-44e3-9e75-2ad11c7e01dc => generated 351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:18:01.846344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b61d4cd5-6163-4a1f-a205-a566d1be4788 tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] Calling method '.version_select at 0x7f3b9f631b80>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:01.980023 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b61d4cd5-6163-4a1f-a205-a566d1be4788 tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.140434 May 19 12:18:01.980943 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 12/17] 10.222.0.23 () {58 vars in 1133 bytes} [Thu May 19 12:18:01 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:01.986435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d3dd669f-dfe4-4f6f-b375-bbde7bf4aeb0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:01.987550 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d3dd669f-dfe4-4f6f-b375-bbde7bf4aeb0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:01.996357 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d3dd669f-dfe4-4f6f-b375-bbde7bf4aeb0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:01.997391 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d3dd669f-dfe4-4f6f-b375-bbde7bf4aeb0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:01.998400 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d3dd669f-dfe4-4f6f-b375-bbde7bf4aeb0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:01.999090 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d3dd669f-dfe4-4f6f-b375-bbde7bf4aeb0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:02.470382 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d3dd669f-dfe4-4f6f-b375-bbde7bf4aeb0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:02.487425 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d3dd669f-dfe4-4f6f-b375-bbde7bf4aeb0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1266 microversion: 2.1 time: 0.505162 May 19 12:18:02.489591 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 13/18] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:01 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1266 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:02.511215 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1bd228fa-cee0-4a90-9b49-6a176a84d866 tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] Calling method '.version_select at 0x7f3b9f5eb4c0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:02.740674 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1bd228fa-cee0-4a90-9b49-6a176a84d866 tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.235082 May 19 12:18:02.740674 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 14/19] 10.222.0.23 () {58 vars in 1148 bytes} [Thu May 19 12:18:02 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:18:02.743464 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-98b9aa07-1af2-4747-9f24-aa7dedc3ca0e tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] Calling method '.version_select at 0x7f3b9f5f3700>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:02.963200 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-98b9aa07-1af2-4747-9f24-aa7dedc3ca0e tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.224373 May 19 12:18:02.964406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 15/20] 10.222.0.23 () {58 vars in 1133 bytes} [Thu May 19 12:18:02 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:02.985549 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bc647c31-b657-4762-8c27-1ce7f2530f29 tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] Calling method '.version_select at 0x7f3b9f5f3af0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:03.162235 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-73d95b02-4c33-4d86-bfd0-18afa2ebc6ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Flavor limits 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:18:03.168711 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-73d95b02-4c33-4d86-bfd0-18afa2ebc6ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Image limits 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:18:03.168711 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-73d95b02-4c33-4d86-bfd0-18afa2ebc6ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Flavor pref 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:18:03.168711 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-73d95b02-4c33-4d86-bfd0-18afa2ebc6ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Image pref 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:18:03.168711 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-73d95b02-4c33-4d86-bfd0-18afa2ebc6ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:18:03.190603 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bc647c31-b657-4762-8c27-1ce7f2530f29 tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.209553 May 19 12:18:03.191530 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 16/21] 10.222.0.23 () {58 vars in 1166 bytes} [Thu May 19 12:18:02 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:18:03.199825 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-73d95b02-4c33-4d86-bfd0-18afa2ebc6ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:03.200357 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-73d95b02-4c33-4d86-bfd0-18afa2ebc6ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:03.201402 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-73d95b02-4c33-4d86-bfd0-18afa2ebc6ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:03.201763 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-73d95b02-4c33-4d86-bfd0-18afa2ebc6ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:03.205018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4639373e-e768-4b1b-a9de-14ca1537e158 tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] Calling method '.version_select at 0x7f3b9f5eb430>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:03.260962 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-73d95b02-4c33-4d86-bfd0-18afa2ebc6ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Getting quotas for project b3d651a605fd4dee95797a7ec3896792. Resources: {'instances', 'ram', 'cores'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:18:03.266796 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-73d95b02-4c33-4d86-bfd0-18afa2ebc6ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Getting quotas for user 8e445569dc5641ed962b0ac977850a6c and project b3d651a605fd4dee95797a7ec3896792. Resources: {'instances', 'ram', 'cores'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:18:03.294921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-73d95b02-4c33-4d86-bfd0-18afa2ebc6ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Going to run 1 instances... {{(pid=117964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:18:03.308326 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-73d95b02-4c33-4d86-bfd0-18afa2ebc6ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962252c6-9c2c-4b81-bdb7-f6d317bada3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:18:03.453642 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4639373e-e768-4b1b-a9de-14ca1537e158 tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.253615 May 19 12:18:03.463269 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 17/22] 10.222.0.23 () {58 vars in 1169 bytes} [Thu May 19 12:18:03 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:18:03.475036 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7e93a221-f3e2-4107-a0e6-7cd1ce1bf529 tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] Calling method '.version_select at 0x7f3b9f615b80>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:03.530875 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-73d95b02-4c33-4d86-bfd0-18afa2ebc6ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.104981 May 19 12:18:03.535828 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 6/23] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:18:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 3114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 12:18:03.555000 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-453785c3-01a0-4f3b-954c-80406488449b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:03.561290 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-453785c3-01a0-4f3b-954c-80406488449b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:03.581389 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-453785c3-01a0-4f3b-954c-80406488449b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:03.613154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-453785c3-01a0-4f3b-954c-80406488449b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:03.614595 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-453785c3-01a0-4f3b-954c-80406488449b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:03.617245 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-453785c3-01a0-4f3b-954c-80406488449b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:03.919903 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7e93a221-f3e2-4107-a0e6-7cd1ce1bf529 tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.440336 May 19 12:18:03.919903 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 18/24] 10.222.0.23 () {58 vars in 1154 bytes} [Thu May 19 12:18:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:03.923262 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-deea8a56-a9cd-4a99-a40a-12afbe7d2ed0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:03.930218 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-deea8a56-a9cd-4a99-a40a-12afbe7d2ed0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:04.345559 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-deea8a56-a9cd-4a99-a40a-12afbe7d2ed0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:04.346136 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-453785c3-01a0-4f3b-954c-80406488449b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:04.364412 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-deea8a56-a9cd-4a99-a40a-12afbe7d2ed0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1221 microversion: 2.1 time: 0.449549 May 19 12:18:04.365230 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 19/25] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:03 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1221 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:04.372392 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-453785c3-01a0-4f3b-954c-80406488449b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1272 microversion: 2.1 time: 0.835137 May 19 12:18:04.387653 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 7/26] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:03 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1272 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:04.392550 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ae696096-743f-4f75-8cb7-17a6219800ba tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] Calling method '.version_select at 0x7f3b9f6e7040>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:04.734971 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ae696096-743f-4f75-8cb7-17a6219800ba tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.368472 May 19 12:18:04.736026 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 20/27] 10.222.0.23 () {58 vars in 1187 bytes} [Thu May 19 12:18:04 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:18:04.750369 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-2e3384de-c83a-42e3-985f-fee00f421d24 tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] Calling method '.version_select at 0x7f3b9e50de50>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:05.031536 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-2e3384de-c83a-42e3-985f-fee00f421d24 tempest-VolumesTestJSON-793530094 tempest-VolumesTestJSON-793530094-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.287731 May 19 12:18:05.034569 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 8/28] 10.222.0.23 () {58 vars in 1154 bytes} [Thu May 19 12:18:04 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:05.398432 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6149ceb8-5dae-4e70-9bcf-de8bc82d351b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:05.400087 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6149ceb8-5dae-4e70-9bcf-de8bc82d351b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:05.415851 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6149ceb8-5dae-4e70-9bcf-de8bc82d351b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:05.416674 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6149ceb8-5dae-4e70-9bcf-de8bc82d351b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:05.417814 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6149ceb8-5dae-4e70-9bcf-de8bc82d351b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:05.420497 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6149ceb8-5dae-4e70-9bcf-de8bc82d351b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:05.650074 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-027b784c-3e9b-4eab-8971-128a31d2df9f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1472898638", "imageRef": "962252c6-9c2c-4b81-bdb7-f6d317bada3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:18:05.744992 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6149ceb8-5dae-4e70-9bcf-de8bc82d351b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:05.770574 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6149ceb8-5dae-4e70-9bcf-de8bc82d351b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1272 microversion: 2.1 time: 0.378679 May 19 12:18:05.774068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 21/29] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:05 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1272 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:05.824773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.network.neutron [None req-027b784c-3e9b-4eab-8971-128a31d2df9f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] validate_networks() for [('e3809f96-195f-4c7b-acab-0be138088685', None, None, None, None, None)] {{(pid=117964) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:18:06.793582 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6831bfde-aceb-4ebf-bfc2-8ddb4ef7f43f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:06.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6831bfde-aceb-4ebf-bfc2-8ddb4ef7f43f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:06.808119 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6831bfde-aceb-4ebf-bfc2-8ddb4ef7f43f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:06.808714 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6831bfde-aceb-4ebf-bfc2-8ddb4ef7f43f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:06.830644 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6831bfde-aceb-4ebf-bfc2-8ddb4ef7f43f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:06.831428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6831bfde-aceb-4ebf-bfc2-8ddb4ef7f43f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:07.317325 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6831bfde-aceb-4ebf-bfc2-8ddb4ef7f43f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:07.378484 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6831bfde-aceb-4ebf-bfc2-8ddb4ef7f43f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1272 microversion: 2.1 time: 0.589383 May 19 12:18:07.419209 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 22/30] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:06 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1272 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:08.167973 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-027b784c-3e9b-4eab-8971-128a31d2df9f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Flavor limits 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:18:08.168973 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-027b784c-3e9b-4eab-8971-128a31d2df9f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Image limits 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:18:08.169341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-027b784c-3e9b-4eab-8971-128a31d2df9f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Flavor pref 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:18:08.170181 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-027b784c-3e9b-4eab-8971-128a31d2df9f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Image pref 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:18:08.170805 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-027b784c-3e9b-4eab-8971-128a31d2df9f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:18:08.216487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-027b784c-3e9b-4eab-8971-128a31d2df9f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:08.219287 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-027b784c-3e9b-4eab-8971-128a31d2df9f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:08.220257 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-027b784c-3e9b-4eab-8971-128a31d2df9f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:08.231882 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-027b784c-3e9b-4eab-8971-128a31d2df9f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:08.282235 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-027b784c-3e9b-4eab-8971-128a31d2df9f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Getting quotas for project b3d651a605fd4dee95797a7ec3896792. Resources: {'instances', 'ram', 'cores'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:18:08.286971 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-027b784c-3e9b-4eab-8971-128a31d2df9f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Getting quotas for user 8e445569dc5641ed962b0ac977850a6c and project b3d651a605fd4dee95797a7ec3896792. Resources: {'instances', 'ram', 'cores'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:18:08.312602 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-027b784c-3e9b-4eab-8971-128a31d2df9f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Going to run 1 instances... {{(pid=117964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:18:08.315541 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-027b784c-3e9b-4eab-8971-128a31d2df9f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962252c6-9c2c-4b81-bdb7-f6d317bada3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:18:08.430351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a8b32b2c-d3ef-454b-bb59-e56aa55177e0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:08.431536 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a8b32b2c-d3ef-454b-bb59-e56aa55177e0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:08.458453 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a8b32b2c-d3ef-454b-bb59-e56aa55177e0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:08.459836 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a8b32b2c-d3ef-454b-bb59-e56aa55177e0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:08.463754 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a8b32b2c-d3ef-454b-bb59-e56aa55177e0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:08.465016 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a8b32b2c-d3ef-454b-bb59-e56aa55177e0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:08.507283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-027b784c-3e9b-4eab-8971-128a31d2df9f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.852689 May 19 12:18:08.507283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 9/31] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:18:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 2860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:18:08.523637 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-495446a5-b286-4fa2-81f9-48af65e2d905 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:08.524240 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-495446a5-b286-4fa2-81f9-48af65e2d905 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:08.905943 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-495446a5-b286-4fa2-81f9-48af65e2d905 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:08.924725 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-495446a5-b286-4fa2-81f9-48af65e2d905 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1222 microversion: 2.1 time: 0.399887 May 19 12:18:08.931242 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 10/32] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:08 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1222 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:09.687364 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a8b32b2c-d3ef-454b-bb59-e56aa55177e0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:09.698457 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a8b32b2c-d3ef-454b-bb59-e56aa55177e0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1314 microversion: 2.1 time: 1.277235 May 19 12:18:09.706285 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 23/33] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:08 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1314 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:09.917722 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-26ff90c2-3476-4c2a-b70e-b4f99f5cbf99 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Action: 'create', calling method: .version_select at 0x7f3b9e4c0af0>, body: {"keypair": {"name": "tempest-keypair-939546334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9CyFkgiUd7g8lL9hutIvIL55ahkID13+LFm048SYGCJn6naYm11ZIqiUpH4W22knsmY5ssMqwjaTqwUHLdEH1kG4bidoumFPup/dFNPu3bZO0h+Ww1fKVLZToutLmK2Q=="}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:18:09.963219 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-569acf30-1885-462a-9ecc-5e1681173ea9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:09.963943 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-569acf30-1885-462a-9ecc-5e1681173ea9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:09.980811 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-26ff90c2-3476-4c2a-b70e-b4f99f5cbf99 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Getting quotas for project 9eafee25cfb14ca2bd5c10fe41a01644. Resources: {'key_pairs'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:18:09.993338 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-26ff90c2-3476-4c2a-b70e-b4f99f5cbf99 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Getting quotas for user 9d762cce00ae4e468c358b0437f35deb and project 9eafee25cfb14ca2bd5c10fe41a01644. Resources: {'key_pairs'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:18:10.182287 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-26ff90c2-3476-4c2a-b70e-b4f99f5cbf99 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.249409 May 19 12:18:10.183227 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 11/34] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 19 12:18:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:18:10.342996 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-569acf30-1885-462a-9ecc-5e1681173ea9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:10.362992 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-569acf30-1885-462a-9ecc-5e1681173ea9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1222 microversion: 2.1 time: 0.402658 May 19 12:18:10.364239 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 24/35] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:09 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1222 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:10.730560 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f8a6809f-7b48-41f4-b366-778fa6b5feb7 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:10.733462 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f8a6809f-7b48-41f4-b366-778fa6b5feb7 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:10.751511 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f8a6809f-7b48-41f4-b366-778fa6b5feb7 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:10.752000 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f8a6809f-7b48-41f4-b366-778fa6b5feb7 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:10.752840 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f8a6809f-7b48-41f4-b366-778fa6b5feb7 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:10.759483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f8a6809f-7b48-41f4-b366-778fa6b5feb7 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:11.391926 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2a2f4698-2451-4cff-9587-08fb8026e04e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:11.393561 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2a2f4698-2451-4cff-9587-08fb8026e04e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:11.406906 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2a2f4698-2451-4cff-9587-08fb8026e04e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:11.408710 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2a2f4698-2451-4cff-9587-08fb8026e04e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:11.412985 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2a2f4698-2451-4cff-9587-08fb8026e04e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:11.417764 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2a2f4698-2451-4cff-9587-08fb8026e04e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:12.240716 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2a2f4698-2451-4cff-9587-08fb8026e04e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:12.275643 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2a2f4698-2451-4cff-9587-08fb8026e04e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1226 microversion: 2.1 time: 0.888376 May 19 12:18:12.278592 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 25/36] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:11 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1226 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:12.983083 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f8a6809f-7b48-41f4-b366-778fa6b5feb7 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:13.015334 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f8a6809f-7b48-41f4-b366-778fa6b5feb7 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1314 microversion: 2.1 time: 2.288288 May 19 12:18:13.020921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 12/37] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:10 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1314 bytes in 2296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:13.316466 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b78aef19-646e-4b75-85e9-65445d5efb83 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:13.318093 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-b78aef19-646e-4b75-85e9-65445d5efb83 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:13.377249 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b78aef19-646e-4b75-85e9-65445d5efb83 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:13.378770 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b78aef19-646e-4b75-85e9-65445d5efb83 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:13.382937 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b78aef19-646e-4b75-85e9-65445d5efb83 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:13.385972 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b78aef19-646e-4b75-85e9-65445d5efb83 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:13.864141 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c8c38f94-3eec-455a-bd52-f0163fc09b41 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Action: 'create', calling method: .version_select at 0x7f3b9f589820>, body: {"keypair": {"name": "tempest-keypair-880790417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8361oj9dHfRY0tF/rZg67JBFXZnWadOdAToWZ5wA6H+0slAoxOtn2zMlsmaJiWGo41h29rv0YeFUFHgr0GUk8FXu2OXy4KqIC1e3W+xAqpAuH/TyXo3C2t6WBWHxHeIw=="}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:18:13.954331 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b78aef19-646e-4b75-85e9-65445d5efb83 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:13.990517 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b78aef19-646e-4b75-85e9-65445d5efb83 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1282 microversion: 2.1 time: 0.682765 May 19 12:18:13.994756 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 13/38] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:13 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1282 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:14.050051 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-47851a45-5c1e-4a91-b441-76e83ee89210 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:14.050051 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-47851a45-5c1e-4a91-b441-76e83ee89210 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:14.075091 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-47851a45-5c1e-4a91-b441-76e83ee89210 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:14.083015 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-47851a45-5c1e-4a91-b441-76e83ee89210 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:14.091981 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-47851a45-5c1e-4a91-b441-76e83ee89210 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:14.092652 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-47851a45-5c1e-4a91-b441-76e83ee89210 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:14.260255 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-c8c38f94-3eec-455a-bd52-f0163fc09b41 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Getting quotas for project 1d2de86d602945238f5df0e2c388004f. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:18:14.291581 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-c8c38f94-3eec-455a-bd52-f0163fc09b41 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Getting quotas for user dd39ddcf4ab045b98a737ee529a2dcce and project 1d2de86d602945238f5df0e2c388004f. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:18:14.610638 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c8c38f94-3eec-455a-bd52-f0163fc09b41 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.353803 May 19 12:18:14.617426 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 26/39] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 19 12:18:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:18:15.024212 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d6c7f146-3134-4210-902a-54172e32c477 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:15.027863 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d6c7f146-3134-4210-902a-54172e32c477 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:15.056836 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d6c7f146-3134-4210-902a-54172e32c477 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:15.061901 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d6c7f146-3134-4210-902a-54172e32c477 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:15.064690 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d6c7f146-3134-4210-902a-54172e32c477 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:15.065766 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d6c7f146-3134-4210-902a-54172e32c477 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:15.199936 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-47851a45-5c1e-4a91-b441-76e83ee89210 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:15.219685 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-47851a45-5c1e-4a91-b441-76e83ee89210 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1314 microversion: 2.1 time: 1.174041 May 19 12:18:15.220629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 14/40] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:14 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1314 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:15.844378 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d6c7f146-3134-4210-902a-54172e32c477 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:15.863605 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d6c7f146-3134-4210-902a-54172e32c477 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1280 microversion: 2.1 time: 0.848174 May 19 12:18:15.872804 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 27/41] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:15 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1280 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:16.245229 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-11292080-9f4c-460f-a4fb-73f0b2d100e6 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:16.245229 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-11292080-9f4c-460f-a4fb-73f0b2d100e6 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:16.253511 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-11292080-9f4c-460f-a4fb-73f0b2d100e6 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:16.253973 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-11292080-9f4c-460f-a4fb-73f0b2d100e6 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:16.254780 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-11292080-9f4c-460f-a4fb-73f0b2d100e6 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:16.255447 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-11292080-9f4c-460f-a4fb-73f0b2d100e6 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:16.887423 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2aa26f29-90de-4a51-9921-d6048ff972d4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:16.891821 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2aa26f29-90de-4a51-9921-d6048ff972d4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:16.916547 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2aa26f29-90de-4a51-9921-d6048ff972d4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:16.919473 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2aa26f29-90de-4a51-9921-d6048ff972d4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:16.925426 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2aa26f29-90de-4a51-9921-d6048ff972d4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:16.926648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2aa26f29-90de-4a51-9921-d6048ff972d4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:18.035004 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2aa26f29-90de-4a51-9921-d6048ff972d4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:18.044675 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2aa26f29-90de-4a51-9921-d6048ff972d4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1280 microversion: 2.1 time: 1.167490 May 19 12:18:18.049258 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 28/42] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:16 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1280 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:18.241208 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=6 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:18.752943 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-11292080-9f4c-460f-a4fb-73f0b2d100e6 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:18.759727 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=35 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:18.791644 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-11292080-9f4c-460f-a4fb-73f0b2d100e6 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1314 microversion: 2.1 time: 2.556412 May 19 12:18:18.804992 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 15/43] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:16 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1314 bytes in 2570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:18.912571 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-faee73aa-79d5-4359-9c94-7b79021b1fcb req-9373fd59-66e7-4f6d-98ce-b4ce46e32b25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86452401-2d6b-4b02-a61a-b5bd76cb996a", "tag": "9b231795-5a6f-4362-ac0e-df73e6325281"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:18:18.939441 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-faee73aa-79d5-4359-9c94-7b79021b1fcb req-9373fd59-66e7-4f6d-98ce-b4ce46e32b25 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:18.939910 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-faee73aa-79d5-4359-9c94-7b79021b1fcb req-9373fd59-66e7-4f6d-98ce-b4ce46e32b25 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:18.985422 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-faee73aa-79d5-4359-9c94-7b79021b1fcb req-9373fd59-66e7-4f6d-98ce-b4ce46e32b25 service nova] Creating event network-changed:9b231795-5a6f-4362-ac0e-df73e6325281 for instance 86452401-2d6b-4b02-a61a-b5bd76cb996a on hv-cinder-80475 May 19 12:18:18.986720 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-faee73aa-79d5-4359-9c94-7b79021b1fcb req-9373fd59-66e7-4f6d-98ce-b4ce46e32b25 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117963) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 12:18:18.988728 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-655c74d5-662b-4c20-817a-7ff770e61238 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:18.989872 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-655c74d5-662b-4c20-817a-7ff770e61238 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:18.992502 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-655c74d5-662b-4c20-817a-7ff770e61238 None None] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:18.993640 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-655c74d5-662b-4c20-817a-7ff770e61238 None None] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:19.013417 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.compute.rpcapi [None req-655c74d5-662b-4c20-817a-7ff770e61238 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 12:18:19.016190 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-655c74d5-662b-4c20-817a-7ff770e61238 None None] Releasing lock "compute-rpcapi-router" {{(pid=117963) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 12:18:19.063598 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-655c74d5-662b-4c20-817a-7ff770e61238 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.309688 May 19 12:18:19.066495 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 29/44] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:18:19.086164 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-29697e7c-a507-42c1-a8e5-e2cd42c93f60 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:19.091568 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-29697e7c-a507-42c1-a8e5-e2cd42c93f60 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:19.095445 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=10 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:19.108615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-29697e7c-a507-42c1-a8e5-e2cd42c93f60 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:19.110140 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-29697e7c-a507-42c1-a8e5-e2cd42c93f60 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:19.112415 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-29697e7c-a507-42c1-a8e5-e2cd42c93f60 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:19.113348 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-29697e7c-a507-42c1-a8e5-e2cd42c93f60 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:19.829105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f1be2c33-6cff-47b8-8cea-2de8fbcba9ed tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:19.831714 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f1be2c33-6cff-47b8-8cea-2de8fbcba9ed tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:19.863465 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f1be2c33-6cff-47b8-8cea-2de8fbcba9ed tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:19.868821 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f1be2c33-6cff-47b8-8cea-2de8fbcba9ed tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:19.870940 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f1be2c33-6cff-47b8-8cea-2de8fbcba9ed tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:19.884831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f1be2c33-6cff-47b8-8cea-2de8fbcba9ed tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:20.019602 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=26 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:20.822031 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-29697e7c-a507-42c1-a8e5-e2cd42c93f60 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:20.858910 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-29697e7c-a507-42c1-a8e5-e2cd42c93f60 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 1.763876 May 19 12:18:20.860143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 16/45] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:19 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:21.135012 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f1be2c33-6cff-47b8-8cea-2de8fbcba9ed tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:21.139328 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=57 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:21.164764 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f1be2c33-6cff-47b8-8cea-2de8fbcba9ed tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1314 microversion: 2.1 time: 1.346694 May 19 12:18:21.184481 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 30/46] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:19 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1314 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:21.892115 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5948ede8-5478-4791-a322-aef4871cf25d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:21.894154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5948ede8-5478-4791-a322-aef4871cf25d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:21.914512 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5948ede8-5478-4791-a322-aef4871cf25d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:21.914512 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5948ede8-5478-4791-a322-aef4871cf25d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:21.914512 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5948ede8-5478-4791-a322-aef4871cf25d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:21.914512 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5948ede8-5478-4791-a322-aef4871cf25d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:22.194687 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f77c0b4d-0ee8-47a6-8df4-7c41e8946c75 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:22.196982 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f77c0b4d-0ee8-47a6-8df4-7c41e8946c75 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:22.208029 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:22.210653 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f77c0b4d-0ee8-47a6-8df4-7c41e8946c75 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:22.214864 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f77c0b4d-0ee8-47a6-8df4-7c41e8946c75 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:22.217396 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f77c0b4d-0ee8-47a6-8df4-7c41e8946c75 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:22.218115 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f77c0b4d-0ee8-47a6-8df4-7c41e8946c75 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:23.874628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5948ede8-5478-4791-a322-aef4871cf25d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:23.886848 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5948ede8-5478-4791-a322-aef4871cf25d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 2.000576 May 19 12:18:23.890733 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 17/47] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:21 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 2005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:24.089703 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f77c0b4d-0ee8-47a6-8df4-7c41e8946c75 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:24.126184 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f77c0b4d-0ee8-47a6-8df4-7c41e8946c75 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1314 microversion: 2.1 time: 1.935725 May 19 12:18:24.134015 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 31/48] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:22 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1314 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:24.859221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-55e3183d-3ae8-46cf-be5b-be0b991c7097 req-84e2238b-57e1-4032-86af-a8d94907d286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c735043f-0342-49b4-9be8-ee27f994a3ed", "tag": "fbbeac60-78b3-4a87-9aeb-fdf2a2c8957f"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:18:24.926394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a2402544-aa1f-4601-ae28-140970b890f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:24.930301 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a2402544-aa1f-4601-ae28-140970b890f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:24.944116 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-55e3183d-3ae8-46cf-be5b-be0b991c7097 req-84e2238b-57e1-4032-86af-a8d94907d286 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:24.947674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-55e3183d-3ae8-46cf-be5b-be0b991c7097 req-84e2238b-57e1-4032-86af-a8d94907d286 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:24.948871 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=12 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:24.965716 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a2402544-aa1f-4601-ae28-140970b890f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:24.966487 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a2402544-aa1f-4601-ae28-140970b890f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:24.972996 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a2402544-aa1f-4601-ae28-140970b890f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:24.974011 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a2402544-aa1f-4601-ae28-140970b890f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:25.143723 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-55e3183d-3ae8-46cf-be5b-be0b991c7097 req-84e2238b-57e1-4032-86af-a8d94907d286 service nova] Creating event network-changed:fbbeac60-78b3-4a87-9aeb-fdf2a2c8957f for instance c735043f-0342-49b4-9be8-ee27f994a3ed on hv-cinder-80475 May 19 12:18:25.143723 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-55e3183d-3ae8-46cf-be5b-be0b991c7097 req-84e2238b-57e1-4032-86af-a8d94907d286 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 12:18:25.151547 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-035383e6-e12d-490d-8e26-2f2171edd9d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:25.157047 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-035383e6-e12d-490d-8e26-2f2171edd9d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:25.166842 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-035383e6-e12d-490d-8e26-2f2171edd9d8 None None] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:25.177496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-035383e6-e12d-490d-8e26-2f2171edd9d8 None None] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:25.235864 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.compute.rpcapi [None req-035383e6-e12d-490d-8e26-2f2171edd9d8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 12:18:25.240702 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-035383e6-e12d-490d-8e26-2f2171edd9d8 None None] Releasing lock "compute-rpcapi-router" {{(pid=117964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 12:18:25.323717 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-035383e6-e12d-490d-8e26-2f2171edd9d8 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.472031 May 19 12:18:25.326419 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 18/49] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:18:25.353006 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d3e46ec7-a837-4aa6-bb14-3625d5196b03 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:25.355124 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d3e46ec7-a837-4aa6-bb14-3625d5196b03 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:25.384163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d3e46ec7-a837-4aa6-bb14-3625d5196b03 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:25.386974 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d3e46ec7-a837-4aa6-bb14-3625d5196b03 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:25.388609 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d3e46ec7-a837-4aa6-bb14-3625d5196b03 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:25.389513 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d3e46ec7-a837-4aa6-bb14-3625d5196b03 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:26.205264 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d3e46ec7-a837-4aa6-bb14-3625d5196b03 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:26.215086 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d3e46ec7-a837-4aa6-bb14-3625d5196b03 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1314 microversion: 2.1 time: 0.886013 May 19 12:18:26.216612 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 19/50] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:25 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1314 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:26.241841 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a2402544-aa1f-4601-ae28-140970b890f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:26.254205 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a2402544-aa1f-4601-ae28-140970b890f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 1.335314 May 19 12:18:26.256700 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 32/51] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:24 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:27.239534 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-1cf53558-7852-4702-8f02-43209d5fd73a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:27.243009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-1cf53558-7852-4702-8f02-43209d5fd73a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:27.279509 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6a19a130-d577-486d-8766-440448d89b5a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:27.285123 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6a19a130-d577-486d-8766-440448d89b5a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:27.296833 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1cf53558-7852-4702-8f02-43209d5fd73a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:27.298067 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1cf53558-7852-4702-8f02-43209d5fd73a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:27.311948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1cf53558-7852-4702-8f02-43209d5fd73a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:27.330674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1cf53558-7852-4702-8f02-43209d5fd73a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:27.342876 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a19a130-d577-486d-8766-440448d89b5a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:27.343581 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a19a130-d577-486d-8766-440448d89b5a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:27.347163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a19a130-d577-486d-8766-440448d89b5a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:27.347903 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a19a130-d577-486d-8766-440448d89b5a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:27.963498 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-1cf53558-7852-4702-8f02-43209d5fd73a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:27.963498 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-1cf53558-7852-4702-8f02-43209d5fd73a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1314 microversion: 2.1 time: 0.724964 May 19 12:18:27.963498 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 20/52] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:27 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1314 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:28.024671 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6a19a130-d577-486d-8766-440448d89b5a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:28.036929 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6a19a130-d577-486d-8766-440448d89b5a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.767817 May 19 12:18:28.037848 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 33/53] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:27 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:28.044191 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e85d1d8d-9f2f-489a-a09f-ab51560d2c5d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1397375849", "imageRef": "962252c6-9c2c-4b81-bdb7-f6d317bada3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "744c5d15-060b-4067-aa62-eecc19d1b85e"}], "security_groups": [{"name": "tempest-securitygroup--2012292010"}], "key_name": "tempest-keypair-880790417", "user_data": "}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:18:28.305122 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-e85d1d8d-9f2f-489a-a09f-ab51560d2c5d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] validate_networks() for [('744c5d15-060b-4067-aa62-eecc19d1b85e', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:18:28.459336 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-fca772fe-501d-4642-8da4-2f56662694e0 req-ba93473b-b0e7-40cd-9a0c-71bd21e81a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b605d4a3-bf90-430f-b2c7-d037b473d29d", "tag": "d6fddd4a-6f06-4062-86e2-9b793547996c"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:18:28.472050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-fca772fe-501d-4642-8da4-2f56662694e0 req-ba93473b-b0e7-40cd-9a0c-71bd21e81a8e service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:28.474841 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-fca772fe-501d-4642-8da4-2f56662694e0 req-ba93473b-b0e7-40cd-9a0c-71bd21e81a8e service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:28.502698 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-fca772fe-501d-4642-8da4-2f56662694e0 req-ba93473b-b0e7-40cd-9a0c-71bd21e81a8e service nova] Creating event network-changed:d6fddd4a-6f06-4062-86e2-9b793547996c for instance b605d4a3-bf90-430f-b2c7-d037b473d29d on hv-cinder-80475 May 19 12:18:28.513558 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-fca772fe-501d-4642-8da4-2f56662694e0 req-ba93473b-b0e7-40cd-9a0c-71bd21e81a8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.555934 May 19 12:18:28.514643 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 21/54] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:18:28.977933 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6e099f67-528f-4dee-b974-6af956226a55 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:28.985148 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6e099f67-528f-4dee-b974-6af956226a55 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:28.985825 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6e099f67-528f-4dee-b974-6af956226a55 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:28.986278 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6e099f67-528f-4dee-b974-6af956226a55 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:28.987059 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6e099f67-528f-4dee-b974-6af956226a55 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:28.987498 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6e099f67-528f-4dee-b974-6af956226a55 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:29.012948 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:29.158713 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6e099f67-528f-4dee-b974-6af956226a55 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:29.174586 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6e099f67-528f-4dee-b974-6af956226a55 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1314 microversion: 2.1 time: 0.201151 May 19 12:18:29.176300 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 22/55] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:28 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:29.190455 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-62b27a35-3d6a-47a4-8087-fc07e65d4233 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:29.191150 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-62b27a35-3d6a-47a4-8087-fc07e65d4233 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:29.198634 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-62b27a35-3d6a-47a4-8087-fc07e65d4233 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:29.199101 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-62b27a35-3d6a-47a4-8087-fc07e65d4233 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:29.199955 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-62b27a35-3d6a-47a4-8087-fc07e65d4233 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:29.200768 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-62b27a35-3d6a-47a4-8087-fc07e65d4233 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:29.420149 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-62b27a35-3d6a-47a4-8087-fc07e65d4233 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:29.429192 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-62b27a35-3d6a-47a4-8087-fc07e65d4233 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.250715 May 19 12:18:29.430149 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 23/56] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:29 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:29.436061 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e0fe8b1d-bcce-4bb7-a702-6296056dd912 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1525579081", "imageRef": "962252c6-9c2c-4b81-bdb7-f6d317bada3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "66d32a70-5928-448a-8e67-919eb5765bfb"}], "security_groups": [{"name": "tempest-securitygroup--2091839779"}], "key_name": "tempest-keypair-939546334", "user_data": "}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:18:29.564325 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.network.neutron [None req-e0fe8b1d-bcce-4bb7-a702-6296056dd912 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] validate_networks() for [('66d32a70-5928-448a-8e67-919eb5765bfb', None, None, None, None, None)] {{(pid=117964) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:18:30.241691 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-e85d1d8d-9f2f-489a-a09f-ab51560d2c5d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:18:30.242971 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-e85d1d8d-9f2f-489a-a09f-ab51560d2c5d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:18:30.243486 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-e85d1d8d-9f2f-489a-a09f-ab51560d2c5d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:18:30.244447 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-e85d1d8d-9f2f-489a-a09f-ab51560d2c5d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:18:30.245109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-e85d1d8d-9f2f-489a-a09f-ab51560d2c5d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:18:30.264371 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e85d1d8d-9f2f-489a-a09f-ab51560d2c5d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:30.265310 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e85d1d8d-9f2f-489a-a09f-ab51560d2c5d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:30.267605 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e85d1d8d-9f2f-489a-a09f-ab51560d2c5d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:30.268241 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e85d1d8d-9f2f-489a-a09f-ab51560d2c5d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:30.313092 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-e85d1d8d-9f2f-489a-a09f-ab51560d2c5d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Getting quotas for project 1d2de86d602945238f5df0e2c388004f. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:18:30.314196 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-e0fe8b1d-bcce-4bb7-a702-6296056dd912 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Flavor limits 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:18:30.314981 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-e0fe8b1d-bcce-4bb7-a702-6296056dd912 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Image limits 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:18:30.316088 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-e0fe8b1d-bcce-4bb7-a702-6296056dd912 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Flavor pref 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:18:30.317117 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-e0fe8b1d-bcce-4bb7-a702-6296056dd912 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Image pref 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:18:30.318252 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-e0fe8b1d-bcce-4bb7-a702-6296056dd912 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:18:30.321077 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-e85d1d8d-9f2f-489a-a09f-ab51560d2c5d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Getting quotas for user dd39ddcf4ab045b98a737ee529a2dcce and project 1d2de86d602945238f5df0e2c388004f. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:18:30.333040 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e0fe8b1d-bcce-4bb7-a702-6296056dd912 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:30.333784 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e0fe8b1d-bcce-4bb7-a702-6296056dd912 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:30.336722 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e0fe8b1d-bcce-4bb7-a702-6296056dd912 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:30.339770 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e0fe8b1d-bcce-4bb7-a702-6296056dd912 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:30.340618 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e85d1d8d-9f2f-489a-a09f-ab51560d2c5d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:18:30.344469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e85d1d8d-9f2f-489a-a09f-ab51560d2c5d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962252c6-9c2c-4b81-bdb7-f6d317bada3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:18:30.360858 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-e0fe8b1d-bcce-4bb7-a702-6296056dd912 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Getting quotas for project 9eafee25cfb14ca2bd5c10fe41a01644. Resources: {'instances', 'ram', 'cores'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:18:30.366251 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-e0fe8b1d-bcce-4bb7-a702-6296056dd912 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Getting quotas for user 9d762cce00ae4e468c358b0437f35deb and project 9eafee25cfb14ca2bd5c10fe41a01644. Resources: {'instances', 'ram', 'cores'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:18:30.386846 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e0fe8b1d-bcce-4bb7-a702-6296056dd912 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Going to run 1 instances... {{(pid=117964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:18:30.389843 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e0fe8b1d-bcce-4bb7-a702-6296056dd912 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962252c6-9c2c-4b81-bdb7-f6d317bada3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:18:30.559815 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e85d1d8d-9f2f-489a-a09f-ab51560d2c5d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.520559 May 19 12:18:30.598618 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 34/57] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:18:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 2522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:18:30.598618 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e13d0437-d065-4bf5-a26e-ab7654fc9cdb tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:30.598618 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e13d0437-d065-4bf5-a26e-ab7654fc9cdb tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:30.598618 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e13d0437-d065-4bf5-a26e-ab7654fc9cdb tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:30.598618 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e13d0437-d065-4bf5-a26e-ab7654fc9cdb tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:30.600642 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e13d0437-d065-4bf5-a26e-ab7654fc9cdb tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:30.600642 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e13d0437-d065-4bf5-a26e-ab7654fc9cdb tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:30.763748 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e13d0437-d065-4bf5-a26e-ab7654fc9cdb tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:30.774983 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e13d0437-d065-4bf5-a26e-ab7654fc9cdb tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1314 microversion: 2.1 time: 0.213191 May 19 12:18:30.775640 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 35/58] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:30 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:30.836125 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c6eaba1e-297e-44df-bd17-364ddef987eb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:30.836125 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c6eaba1e-297e-44df-bd17-364ddef987eb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:30.844864 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c6eaba1e-297e-44df-bd17-364ddef987eb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:30.845698 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c6eaba1e-297e-44df-bd17-364ddef987eb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:30.847211 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c6eaba1e-297e-44df-bd17-364ddef987eb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:30.848284 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c6eaba1e-297e-44df-bd17-364ddef987eb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:31.055803 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c6eaba1e-297e-44df-bd17-364ddef987eb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:31.063827 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c6eaba1e-297e-44df-bd17-364ddef987eb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.286936 May 19 12:18:31.064514 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 36/59] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:30 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:31.074455 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f5518a52-f596-4b50-9aa5-66db59cd019e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:31.075625 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f5518a52-f596-4b50-9aa5-66db59cd019e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:31.151451 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f5518a52-f596-4b50-9aa5-66db59cd019e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:31.168970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f5518a52-f596-4b50-9aa5-66db59cd019e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1241 microversion: 2.1 time: 0.102511 May 19 12:18:31.170035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 37/60] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:31 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1241 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:31.685527 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e0fe8b1d-bcce-4bb7-a702-6296056dd912 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.253736 May 19 12:18:31.686910 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 24/61] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:18:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 2256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:18:31.704216 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2d63b221-9f5c-4b89-9a68-1858abe7ac52 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:31.705917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2d63b221-9f5c-4b89-9a68-1858abe7ac52 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:31.785132 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2d63b221-9f5c-4b89-9a68-1858abe7ac52 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:31.794887 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2d63b221-9f5c-4b89-9a68-1858abe7ac52 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1237 microversion: 2.1 time: 0.097972 May 19 12:18:31.799990 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 38/62] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:31 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1237 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:31.840469 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-520ec387-7961-470d-b6f8-d6d7dada87b4 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:31.841432 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-520ec387-7961-470d-b6f8-d6d7dada87b4 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:31.850291 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-520ec387-7961-470d-b6f8-d6d7dada87b4 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:31.850844 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-520ec387-7961-470d-b6f8-d6d7dada87b4 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:31.852256 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-520ec387-7961-470d-b6f8-d6d7dada87b4 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:31.852757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-520ec387-7961-470d-b6f8-d6d7dada87b4 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:32.084431 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-520ec387-7961-470d-b6f8-d6d7dada87b4 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:32.093093 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-afa73694-5e96-4ebe-b0e5-763d7a60dbcc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:32.095370 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-520ec387-7961-470d-b6f8-d6d7dada87b4 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1314 microversion: 2.1 time: 0.261670 May 19 12:18:32.100805 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-afa73694-5e96-4ebe-b0e5-763d7a60dbcc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:32.107070 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 25/63] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:31 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:32.129744 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-afa73694-5e96-4ebe-b0e5-763d7a60dbcc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:32.129744 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-afa73694-5e96-4ebe-b0e5-763d7a60dbcc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:32.130831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-afa73694-5e96-4ebe-b0e5-763d7a60dbcc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:32.131413 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-afa73694-5e96-4ebe-b0e5-763d7a60dbcc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:32.190986 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-1a9fd876-4dc7-4109-97de-15ae3cfd95da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:32.192140 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-1a9fd876-4dc7-4109-97de-15ae3cfd95da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:32.296272 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-1a9fd876-4dc7-4109-97de-15ae3cfd95da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:32.308225 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-1a9fd876-4dc7-4109-97de-15ae3cfd95da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1241 microversion: 2.1 time: 0.120359 May 19 12:18:32.308225 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 26/64] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:32 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1241 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:32.428534 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-afa73694-5e96-4ebe-b0e5-763d7a60dbcc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:32.442325 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-afa73694-5e96-4ebe-b0e5-763d7a60dbcc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.355916 May 19 12:18:32.446287 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 39/65] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:32 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:32.823881 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b4deb415-ade3-4c36-8a8c-bab0b668b696 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:32.826020 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-b4deb415-ade3-4c36-8a8c-bab0b668b696 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:32.933234 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b4deb415-ade3-4c36-8a8c-bab0b668b696 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:32.950756 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b4deb415-ade3-4c36-8a8c-bab0b668b696 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1237 microversion: 2.1 time: 0.132156 May 19 12:18:32.973830 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 27/66] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:32 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1237 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:33.124944 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-75b00151-631b-4776-9f2d-d5ae532213b0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:33.126301 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-75b00151-631b-4776-9f2d-d5ae532213b0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:33.153934 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-75b00151-631b-4776-9f2d-d5ae532213b0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:33.159947 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-75b00151-631b-4776-9f2d-d5ae532213b0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:33.161891 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-75b00151-631b-4776-9f2d-d5ae532213b0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:33.163182 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-75b00151-631b-4776-9f2d-d5ae532213b0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:33.329590 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e3e84aab-9a7c-4ade-8932-75baed1e3548 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:33.330393 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e3e84aab-9a7c-4ade-8932-75baed1e3548 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:33.351845 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e3e84aab-9a7c-4ade-8932-75baed1e3548 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:33.353240 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e3e84aab-9a7c-4ade-8932-75baed1e3548 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:33.355247 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e3e84aab-9a7c-4ade-8932-75baed1e3548 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:33.363168 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e3e84aab-9a7c-4ade-8932-75baed1e3548 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:33.495949 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e3e84aab-9a7c-4ade-8932-75baed1e3548 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:33.505265 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e3e84aab-9a7c-4ade-8932-75baed1e3548 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1245 microversion: 2.1 time: 0.181956 May 19 12:18:33.506318 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 28/67] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:33 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1245 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:33.519688 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b39940e7-05aa-44e0-9ad5-1298beb9c1ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:33.520523 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-b39940e7-05aa-44e0-9ad5-1298beb9c1ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:33.535587 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b39940e7-05aa-44e0-9ad5-1298beb9c1ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:33.536170 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b39940e7-05aa-44e0-9ad5-1298beb9c1ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:33.537731 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b39940e7-05aa-44e0-9ad5-1298beb9c1ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:33.538260 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b39940e7-05aa-44e0-9ad5-1298beb9c1ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:33.590128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-75b00151-631b-4776-9f2d-d5ae532213b0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:33.600066 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-75b00151-631b-4776-9f2d-d5ae532213b0 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1314 microversion: 2.1 time: 0.490143 May 19 12:18:33.605552 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 40/68] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:33 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:33.763459 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b39940e7-05aa-44e0-9ad5-1298beb9c1ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:33.778680 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b39940e7-05aa-44e0-9ad5-1298beb9c1ac tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.269922 May 19 12:18:33.780119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 29/69] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:33 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:33.985474 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-130c82c1-4799-4556-9dd0-e9703ee52156 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:33.987287 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-130c82c1-4799-4556-9dd0-e9703ee52156 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:33.998404 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-130c82c1-4799-4556-9dd0-e9703ee52156 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:33.999141 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-130c82c1-4799-4556-9dd0-e9703ee52156 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:34.000485 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-130c82c1-4799-4556-9dd0-e9703ee52156 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:34.001185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-130c82c1-4799-4556-9dd0-e9703ee52156 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:34.127833 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-130c82c1-4799-4556-9dd0-e9703ee52156 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:34.140967 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-130c82c1-4799-4556-9dd0-e9703ee52156 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1241 microversion: 2.1 time: 0.165719 May 19 12:18:34.143972 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 41/70] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:33 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1241 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:34.525697 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-273571ef-ef4f-4ad3-a498-689bb26a1258 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:34.526924 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-273571ef-ef4f-4ad3-a498-689bb26a1258 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:34.534097 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-273571ef-ef4f-4ad3-a498-689bb26a1258 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:34.534767 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-273571ef-ef4f-4ad3-a498-689bb26a1258 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:34.535766 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-273571ef-ef4f-4ad3-a498-689bb26a1258 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:34.536346 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-273571ef-ef4f-4ad3-a498-689bb26a1258 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:34.624055 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1f984471-801b-4fb4-a000-27bb3e83ebee tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:34.624913 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1f984471-801b-4fb4-a000-27bb3e83ebee tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:34.632940 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-273571ef-ef4f-4ad3-a498-689bb26a1258 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:34.633704 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1f984471-801b-4fb4-a000-27bb3e83ebee tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:34.635232 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1f984471-801b-4fb4-a000-27bb3e83ebee tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:34.636388 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1f984471-801b-4fb4-a000-27bb3e83ebee tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:34.636885 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1f984471-801b-4fb4-a000-27bb3e83ebee tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:34.643330 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-273571ef-ef4f-4ad3-a498-689bb26a1258 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1245 microversion: 2.1 time: 0.123523 May 19 12:18:34.644331 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 30/71] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:34 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1245 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:34.811235 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f564e9bb-c8b4-4fa7-bff3-4b715ffe05d0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:34.812457 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f564e9bb-c8b4-4fa7-bff3-4b715ffe05d0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:34.823917 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f564e9bb-c8b4-4fa7-bff3-4b715ffe05d0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:34.824980 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f564e9bb-c8b4-4fa7-bff3-4b715ffe05d0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:34.826587 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f564e9bb-c8b4-4fa7-bff3-4b715ffe05d0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:34.827357 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f564e9bb-c8b4-4fa7-bff3-4b715ffe05d0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:34.851945 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1f984471-801b-4fb4-a000-27bb3e83ebee tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:34.870588 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1f984471-801b-4fb4-a000-27bb3e83ebee tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1314 microversion: 2.1 time: 0.253985 May 19 12:18:34.872102 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 42/72] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:34 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:35.090337 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f564e9bb-c8b4-4fa7-bff3-4b715ffe05d0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:35.108542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f564e9bb-c8b4-4fa7-bff3-4b715ffe05d0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.306135 May 19 12:18:35.109724 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 31/73] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:34 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:35.167163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6cc0fd9a-e479-4e4b-92b7-c050c85cddda tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:35.167775 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6cc0fd9a-e479-4e4b-92b7-c050c85cddda tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:35.177719 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6cc0fd9a-e479-4e4b-92b7-c050c85cddda tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:35.178542 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6cc0fd9a-e479-4e4b-92b7-c050c85cddda tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:35.180672 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6cc0fd9a-e479-4e4b-92b7-c050c85cddda tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:35.181454 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6cc0fd9a-e479-4e4b-92b7-c050c85cddda tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:35.262226 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6cc0fd9a-e479-4e4b-92b7-c050c85cddda tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:35.276179 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6cc0fd9a-e479-4e4b-92b7-c050c85cddda tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1241 microversion: 2.1 time: 0.113029 May 19 12:18:35.277216 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 43/74] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:35 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1241 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:35.666610 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-850d297e-27ff-45bb-b44f-9068ff7ac1b9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:35.668709 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-850d297e-27ff-45bb-b44f-9068ff7ac1b9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:35.685087 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-850d297e-27ff-45bb-b44f-9068ff7ac1b9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:35.686360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-850d297e-27ff-45bb-b44f-9068ff7ac1b9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:35.688927 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-850d297e-27ff-45bb-b44f-9068ff7ac1b9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:35.689955 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-850d297e-27ff-45bb-b44f-9068ff7ac1b9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:35.879539 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-850d297e-27ff-45bb-b44f-9068ff7ac1b9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:35.893512 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b40988ad-a30f-4740-b952-5bf275d2ab9f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:35.894871 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b40988ad-a30f-4740-b952-5bf275d2ab9f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:35.925249 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b40988ad-a30f-4740-b952-5bf275d2ab9f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:35.932192 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-850d297e-27ff-45bb-b44f-9068ff7ac1b9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1245 microversion: 2.1 time: 0.260653 May 19 12:18:35.935956 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b40988ad-a30f-4740-b952-5bf275d2ab9f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:35.936645 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 32/75] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:35 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1245 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:35.938373 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b40988ad-a30f-4740-b952-5bf275d2ab9f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:35.941461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b40988ad-a30f-4740-b952-5bf275d2ab9f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:36.131240 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-666a7f35-211a-4144-aebd-b981060506f2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:36.133313 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-666a7f35-211a-4144-aebd-b981060506f2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:36.158215 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-666a7f35-211a-4144-aebd-b981060506f2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:36.161627 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-666a7f35-211a-4144-aebd-b981060506f2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:36.161627 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-666a7f35-211a-4144-aebd-b981060506f2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:36.163233 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-666a7f35-211a-4144-aebd-b981060506f2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:36.334715 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b40988ad-a30f-4740-b952-5bf275d2ab9f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:36.344520 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b40988ad-a30f-4740-b952-5bf275d2ab9f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1314 microversion: 2.1 time: 0.458627 May 19 12:18:36.345243 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 44/76] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:35 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:36.350567 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b1663001-272c-4c88-9819-03b7591cf054 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:36.351838 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b1663001-272c-4c88-9819-03b7591cf054 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:36.359163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b1663001-272c-4c88-9819-03b7591cf054 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:36.359892 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b1663001-272c-4c88-9819-03b7591cf054 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:36.360913 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b1663001-272c-4c88-9819-03b7591cf054 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:36.379094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b1663001-272c-4c88-9819-03b7591cf054 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:36.491107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-666a7f35-211a-4144-aebd-b981060506f2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:36.508778 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-666a7f35-211a-4144-aebd-b981060506f2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.384142 May 19 12:18:36.510604 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 33/77] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:36 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:36.517827 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b1663001-272c-4c88-9819-03b7591cf054 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:36.528309 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b1663001-272c-4c88-9819-03b7591cf054 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1241 microversion: 2.1 time: 0.181805 May 19 12:18:36.529385 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 45/78] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:36 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1241 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:36.721394 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-d78164f9-94e0-4d78-849f-fcfaaf4d7d5f req-f35a89ef-582a-40bc-81a9-cf4adeab52c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86452401-2d6b-4b02-a61a-b5bd76cb996a", "name": "network-vif-plugged", "status": "completed", "tag": "9b231795-5a6f-4362-ac0e-df73e6325281"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:18:36.734237 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-d78164f9-94e0-4d78-849f-fcfaaf4d7d5f req-f35a89ef-582a-40bc-81a9-cf4adeab52c6 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:36.734975 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-d78164f9-94e0-4d78-849f-fcfaaf4d7d5f req-f35a89ef-582a-40bc-81a9-cf4adeab52c6 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:36.753171 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-d78164f9-94e0-4d78-849f-fcfaaf4d7d5f req-f35a89ef-582a-40bc-81a9-cf4adeab52c6 service nova] Creating event network-vif-plugged:9b231795-5a6f-4362-ac0e-df73e6325281 for instance 86452401-2d6b-4b02-a61a-b5bd76cb996a on hv-cinder-80475 May 19 12:18:36.760091 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-d78164f9-94e0-4d78-849f-fcfaaf4d7d5f req-f35a89ef-582a-40bc-81a9-cf4adeab52c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247333 May 19 12:18:36.761297 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 34/79] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:18:36.957448 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f46bbe84-1ab7-450a-92d1-b06e496747e1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:36.958468 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f46bbe84-1ab7-450a-92d1-b06e496747e1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:36.966007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f46bbe84-1ab7-450a-92d1-b06e496747e1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:36.966461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f46bbe84-1ab7-450a-92d1-b06e496747e1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:36.967254 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f46bbe84-1ab7-450a-92d1-b06e496747e1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:36.967689 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f46bbe84-1ab7-450a-92d1-b06e496747e1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:37.054786 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f46bbe84-1ab7-450a-92d1-b06e496747e1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:37.069481 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f46bbe84-1ab7-450a-92d1-b06e496747e1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1245 microversion: 2.1 time: 0.109754 May 19 12:18:37.071078 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 46/80] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:36 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1245 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:37.363576 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-724dd3a4-6d0a-43b0-b08b-6b73b83ae962 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:37.364319 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-724dd3a4-6d0a-43b0-b08b-6b73b83ae962 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:37.371955 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-724dd3a4-6d0a-43b0-b08b-6b73b83ae962 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:37.372514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-724dd3a4-6d0a-43b0-b08b-6b73b83ae962 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:37.373339 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-724dd3a4-6d0a-43b0-b08b-6b73b83ae962 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:37.373789 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-724dd3a4-6d0a-43b0-b08b-6b73b83ae962 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:37.540870 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d333ccc3-7384-48d0-93e0-7f19ec2bf5d0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:37.541395 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d333ccc3-7384-48d0-93e0-7f19ec2bf5d0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:37.560107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-724dd3a4-6d0a-43b0-b08b-6b73b83ae962 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:37.565523 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d333ccc3-7384-48d0-93e0-7f19ec2bf5d0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:37.566561 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d333ccc3-7384-48d0-93e0-7f19ec2bf5d0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:37.570660 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d333ccc3-7384-48d0-93e0-7f19ec2bf5d0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:37.592559 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d333ccc3-7384-48d0-93e0-7f19ec2bf5d0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:37.593430 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-724dd3a4-6d0a-43b0-b08b-6b73b83ae962 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1314 microversion: 2.1 time: 0.215406 May 19 12:18:37.593430 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 35/81] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:37 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:37.593430 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5b26b526-249d-498a-b5e0-76862d186e79 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:37.593430 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5b26b526-249d-498a-b5e0-76862d186e79 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:37.599879 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5b26b526-249d-498a-b5e0-76862d186e79 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:37.600302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5b26b526-249d-498a-b5e0-76862d186e79 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:37.602796 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5b26b526-249d-498a-b5e0-76862d186e79 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:37.603775 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5b26b526-249d-498a-b5e0-76862d186e79 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:37.745722 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5b26b526-249d-498a-b5e0-76862d186e79 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:37.756237 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=100 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:37.765110 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5b26b526-249d-498a-b5e0-76862d186e79 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1241 microversion: 2.1 time: 0.187831 May 19 12:18:37.776630 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 36/82] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:37 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1241 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:37.880880 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d333ccc3-7384-48d0-93e0-7f19ec2bf5d0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:37.905180 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d333ccc3-7384-48d0-93e0-7f19ec2bf5d0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.374317 May 19 12:18:37.907356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 47/83] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:37 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:38.099222 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-644c92cd-5db4-4d36-a82c-dafede72374b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:38.100230 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-644c92cd-5db4-4d36-a82c-dafede72374b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:38.111621 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-644c92cd-5db4-4d36-a82c-dafede72374b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:38.113369 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-644c92cd-5db4-4d36-a82c-dafede72374b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:38.115661 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-644c92cd-5db4-4d36-a82c-dafede72374b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:38.119014 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-644c92cd-5db4-4d36-a82c-dafede72374b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:38.266544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-644c92cd-5db4-4d36-a82c-dafede72374b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:38.280747 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-644c92cd-5db4-4d36-a82c-dafede72374b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1245 microversion: 2.1 time: 0.195149 May 19 12:18:38.305389 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 37/84] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:38 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1245 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:38.608210 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e7e0f457-408d-4633-a27a-0d667dbcba93 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:38.609457 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e7e0f457-408d-4633-a27a-0d667dbcba93 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:38.621399 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e7e0f457-408d-4633-a27a-0d667dbcba93 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:38.623247 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e7e0f457-408d-4633-a27a-0d667dbcba93 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:38.624775 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e7e0f457-408d-4633-a27a-0d667dbcba93 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:38.627605 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e7e0f457-408d-4633-a27a-0d667dbcba93 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:38.783731 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d064b654-8aef-474d-ab4f-8992df983452 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:38.785721 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d064b654-8aef-474d-ab4f-8992df983452 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:38.799502 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d064b654-8aef-474d-ab4f-8992df983452 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:38.803625 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d064b654-8aef-474d-ab4f-8992df983452 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:38.804977 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d064b654-8aef-474d-ab4f-8992df983452 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:38.805683 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d064b654-8aef-474d-ab4f-8992df983452 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:38.986871 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d064b654-8aef-474d-ab4f-8992df983452 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:39.011541 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d064b654-8aef-474d-ab4f-8992df983452 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1289 microversion: 2.1 time: 0.232241 May 19 12:18:39.027448 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 38/85] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:38 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1289 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:39.033076 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-74cbabc0-009a-4ad3-b01b-929eb8c0bca7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:39.034107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-74cbabc0-009a-4ad3-b01b-929eb8c0bca7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:39.041959 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-74cbabc0-009a-4ad3-b01b-929eb8c0bca7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:39.042799 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-74cbabc0-009a-4ad3-b01b-929eb8c0bca7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:39.043835 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-74cbabc0-009a-4ad3-b01b-929eb8c0bca7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:39.044493 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-74cbabc0-009a-4ad3-b01b-929eb8c0bca7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:39.197371 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e7e0f457-408d-4633-a27a-0d667dbcba93 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:39.206111 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e7e0f457-408d-4633-a27a-0d667dbcba93 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1314 microversion: 2.1 time: 0.603634 May 19 12:18:39.206711 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 48/86] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:38 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:39.312178 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f7f87243-ea74-4cf7-8a01-4f0bd690f4ce tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:39.313254 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f7f87243-ea74-4cf7-8a01-4f0bd690f4ce tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:39.327908 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-74cbabc0-009a-4ad3-b01b-929eb8c0bca7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:39.331542 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f7f87243-ea74-4cf7-8a01-4f0bd690f4ce tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:39.332723 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f7f87243-ea74-4cf7-8a01-4f0bd690f4ce tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:39.344208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f7f87243-ea74-4cf7-8a01-4f0bd690f4ce tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:39.345578 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f7f87243-ea74-4cf7-8a01-4f0bd690f4ce tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:39.385605 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-74cbabc0-009a-4ad3-b01b-929eb8c0bca7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.351538 May 19 12:18:39.385605 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 39/87] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:39 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:39.506376 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f7f87243-ea74-4cf7-8a01-4f0bd690f4ce tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:39.542682 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f7f87243-ea74-4cf7-8a01-4f0bd690f4ce tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1293 microversion: 2.1 time: 0.242883 May 19 12:18:39.547674 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 49/88] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:39 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1293 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:40.034769 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-db56d0c2-4f9e-41f5-88b1-0237e2597a81 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:40.035577 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-db56d0c2-4f9e-41f5-88b1-0237e2597a81 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:40.063973 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-db56d0c2-4f9e-41f5-88b1-0237e2597a81 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:40.065423 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-db56d0c2-4f9e-41f5-88b1-0237e2597a81 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:40.066260 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-db56d0c2-4f9e-41f5-88b1-0237e2597a81 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:40.066718 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-db56d0c2-4f9e-41f5-88b1-0237e2597a81 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:40.193623 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-db56d0c2-4f9e-41f5-88b1-0237e2597a81 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:40.206731 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-db56d0c2-4f9e-41f5-88b1-0237e2597a81 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1297 microversion: 2.1 time: 0.177566 May 19 12:18:40.208095 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 40/89] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:40 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1297 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:40.228144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-025ecd60-80f4-4768-acb4-5b787858f8ac tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:40.229400 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-025ecd60-80f4-4768-acb4-5b787858f8ac tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:40.238289 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-025ecd60-80f4-4768-acb4-5b787858f8ac tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:40.238639 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-025ecd60-80f4-4768-acb4-5b787858f8ac tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:40.239600 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-025ecd60-80f4-4768-acb4-5b787858f8ac tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:40.241177 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-025ecd60-80f4-4768-acb4-5b787858f8ac tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:40.246807 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:40.295503 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:40.405625 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5df99f4b-7abf-4351-8cbc-9f964b6d2faa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:40.406408 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5df99f4b-7abf-4351-8cbc-9f964b6d2faa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:40.408988 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=4 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:40.415306 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-025ecd60-80f4-4768-acb4-5b787858f8ac tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:40.418967 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5df99f4b-7abf-4351-8cbc-9f964b6d2faa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:40.419668 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5df99f4b-7abf-4351-8cbc-9f964b6d2faa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:40.420674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5df99f4b-7abf-4351-8cbc-9f964b6d2faa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:40.421111 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5df99f4b-7abf-4351-8cbc-9f964b6d2faa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:40.429830 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-025ecd60-80f4-4768-acb4-5b787858f8ac tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1314 microversion: 2.1 time: 0.206224 May 19 12:18:40.430772 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 50/90] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:40 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:40.562611 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7ad85541-9a70-4bb3-9e1c-cc06b6cc84c6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:40.563333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7ad85541-9a70-4bb3-9e1c-cc06b6cc84c6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:40.571273 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7ad85541-9a70-4bb3-9e1c-cc06b6cc84c6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:40.571273 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7ad85541-9a70-4bb3-9e1c-cc06b6cc84c6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:40.571740 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7ad85541-9a70-4bb3-9e1c-cc06b6cc84c6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:40.572391 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7ad85541-9a70-4bb3-9e1c-cc06b6cc84c6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:40.579164 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5df99f4b-7abf-4351-8cbc-9f964b6d2faa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:40.593110 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5df99f4b-7abf-4351-8cbc-9f964b6d2faa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.191542 May 19 12:18:40.594081 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 41/91] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:40 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:40.650291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7ad85541-9a70-4bb3-9e1c-cc06b6cc84c6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:40.660639 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7ad85541-9a70-4bb3-9e1c-cc06b6cc84c6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1301 microversion: 2.1 time: 0.101690 May 19 12:18:40.661227 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 51/92] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:40 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1301 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:41.225457 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-dd1d92c1-d659-4bdf-ab5e-3cb6d8161822 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:41.226973 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-dd1d92c1-d659-4bdf-ab5e-3cb6d8161822 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:41.239620 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dd1d92c1-d659-4bdf-ab5e-3cb6d8161822 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:41.240244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dd1d92c1-d659-4bdf-ab5e-3cb6d8161822 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:41.241022 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dd1d92c1-d659-4bdf-ab5e-3cb6d8161822 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:41.246739 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dd1d92c1-d659-4bdf-ab5e-3cb6d8161822 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:41.321441 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-dd1d92c1-d659-4bdf-ab5e-3cb6d8161822 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:41.330775 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-dd1d92c1-d659-4bdf-ab5e-3cb6d8161822 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1297 microversion: 2.1 time: 0.109791 May 19 12:18:41.331474 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 42/93] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:41 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1297 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:41.458538 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-79108b62-d088-4eb9-a376-3b63b45b5b3f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:41.459238 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-79108b62-d088-4eb9-a376-3b63b45b5b3f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:41.467215 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-79108b62-d088-4eb9-a376-3b63b45b5b3f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:41.467675 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-79108b62-d088-4eb9-a376-3b63b45b5b3f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:41.468500 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-79108b62-d088-4eb9-a376-3b63b45b5b3f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:41.468952 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-79108b62-d088-4eb9-a376-3b63b45b5b3f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:41.611506 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-1cf8b2c8-463f-45ba-a5d3-55a2f4c5e2e0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:41.612211 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-1cf8b2c8-463f-45ba-a5d3-55a2f4c5e2e0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:41.621088 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1cf8b2c8-463f-45ba-a5d3-55a2f4c5e2e0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:41.626088 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1cf8b2c8-463f-45ba-a5d3-55a2f4c5e2e0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:41.626088 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1cf8b2c8-463f-45ba-a5d3-55a2f4c5e2e0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:41.626450 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-79108b62-d088-4eb9-a376-3b63b45b5b3f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:41.626616 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1cf8b2c8-463f-45ba-a5d3-55a2f4c5e2e0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:41.634775 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-79108b62-d088-4eb9-a376-3b63b45b5b3f tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1314 microversion: 2.1 time: 0.180661 May 19 12:18:41.635716 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 52/94] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:41 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:41.691592 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-54199115-62e2-4e2b-8263-dc33e921c532 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:41.691592 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-54199115-62e2-4e2b-8263-dc33e921c532 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:41.709565 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-54199115-62e2-4e2b-8263-dc33e921c532 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:41.710010 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-54199115-62e2-4e2b-8263-dc33e921c532 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:41.713527 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-54199115-62e2-4e2b-8263-dc33e921c532 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:41.714343 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-54199115-62e2-4e2b-8263-dc33e921c532 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:41.788954 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=10 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:42.010893 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-54199115-62e2-4e2b-8263-dc33e921c532 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:42.034309 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-54199115-62e2-4e2b-8263-dc33e921c532 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1311 microversion: 2.1 time: 0.344416 May 19 12:18:42.035427 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 53/95] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:41 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1311 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:42.086262 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-1cf8b2c8-463f-45ba-a5d3-55a2f4c5e2e0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:42.096399 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-1cf8b2c8-463f-45ba-a5d3-55a2f4c5e2e0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.487753 May 19 12:18:42.097015 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 43/96] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:41 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:42.166895 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-5eae3d33-e858-4615-9e4d-b748b9407bde req-d8823aa5-e73f-41b3-806d-4e5a5b7febc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c735043f-0342-49b4-9be8-ee27f994a3ed", "name": "network-vif-plugged", "status": "completed", "tag": "fbbeac60-78b3-4a87-9aeb-fdf2a2c8957f"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:18:42.182319 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-5eae3d33-e858-4615-9e4d-b748b9407bde req-d8823aa5-e73f-41b3-806d-4e5a5b7febc4 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:42.183175 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-5eae3d33-e858-4615-9e4d-b748b9407bde req-d8823aa5-e73f-41b3-806d-4e5a5b7febc4 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:42.197542 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-5eae3d33-e858-4615-9e4d-b748b9407bde req-d8823aa5-e73f-41b3-806d-4e5a5b7febc4 service nova] Creating event network-vif-plugged:fbbeac60-78b3-4a87-9aeb-fdf2a2c8957f for instance c735043f-0342-49b4-9be8-ee27f994a3ed on hv-cinder-80475 May 19 12:18:42.203179 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-5eae3d33-e858-4615-9e4d-b748b9407bde req-d8823aa5-e73f-41b3-806d-4e5a5b7febc4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043815 May 19 12:18:42.205142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 54/97] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:18:42.355865 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-92a57e83-13b5-4976-b953-ced3e3181cf5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:42.358251 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-92a57e83-13b5-4976-b953-ced3e3181cf5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:42.394731 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-92a57e83-13b5-4976-b953-ced3e3181cf5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:42.394731 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-92a57e83-13b5-4976-b953-ced3e3181cf5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:42.394731 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-92a57e83-13b5-4976-b953-ced3e3181cf5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:42.394731 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-92a57e83-13b5-4976-b953-ced3e3181cf5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:42.526010 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-92a57e83-13b5-4976-b953-ced3e3181cf5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:42.535613 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-92a57e83-13b5-4976-b953-ced3e3181cf5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1295 microversion: 2.1 time: 0.190517 May 19 12:18:42.549740 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 44/98] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:42 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1295 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:42.652781 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d13fd78e-066b-4a44-b81a-4da3f46aba63 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:42.653422 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d13fd78e-066b-4a44-b81a-4da3f46aba63 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:42.661769 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d13fd78e-066b-4a44-b81a-4da3f46aba63 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:42.662514 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d13fd78e-066b-4a44-b81a-4da3f46aba63 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:42.663620 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d13fd78e-066b-4a44-b81a-4da3f46aba63 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:42.664464 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d13fd78e-066b-4a44-b81a-4da3f46aba63 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:42.970018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d13fd78e-066b-4a44-b81a-4da3f46aba63 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:42.984673 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d13fd78e-066b-4a44-b81a-4da3f46aba63 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1314 microversion: 2.1 time: 0.336878 May 19 12:18:42.988289 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 55/99] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:42 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:43.059318 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-021bac58-aa62-45db-b15b-6c53c9950315 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:43.060340 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-021bac58-aa62-45db-b15b-6c53c9950315 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:43.062601 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=10 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:43.072157 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-021bac58-aa62-45db-b15b-6c53c9950315 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:43.072930 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-021bac58-aa62-45db-b15b-6c53c9950315 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:43.079559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-021bac58-aa62-45db-b15b-6c53c9950315 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:43.079559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-021bac58-aa62-45db-b15b-6c53c9950315 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:43.114803 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2687aad9-c725-49e4-baab-1146731609d6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:43.115427 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2687aad9-c725-49e4-baab-1146731609d6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:43.140312 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2687aad9-c725-49e4-baab-1146731609d6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:43.153691 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2687aad9-c725-49e4-baab-1146731609d6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:43.154624 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2687aad9-c725-49e4-baab-1146731609d6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:43.155097 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2687aad9-c725-49e4-baab-1146731609d6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:43.408177 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-021bac58-aa62-45db-b15b-6c53c9950315 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:43.436409 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-021bac58-aa62-45db-b15b-6c53c9950315 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.384893 May 19 12:18:43.437586 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 45/100] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:43 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:43.503438 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2687aad9-c725-49e4-baab-1146731609d6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:43.516840 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2687aad9-c725-49e4-baab-1146731609d6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.406254 May 19 12:18:43.526437 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 56/101] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:43 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:43.569123 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-08d20fc9-a370-4412-b02f-b8e57e4b8674 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:43.569915 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-08d20fc9-a370-4412-b02f-b8e57e4b8674 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:43.578843 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-08d20fc9-a370-4412-b02f-b8e57e4b8674 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:43.579621 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-08d20fc9-a370-4412-b02f-b8e57e4b8674 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:43.580651 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-08d20fc9-a370-4412-b02f-b8e57e4b8674 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:43.581104 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-08d20fc9-a370-4412-b02f-b8e57e4b8674 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:43.856150 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-08d20fc9-a370-4412-b02f-b8e57e4b8674 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:43.864824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-08d20fc9-a370-4412-b02f-b8e57e4b8674 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.301224 May 19 12:18:43.865645 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 46/102] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:43 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:44.003294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a62d21ad-0331-43bf-828d-62d6ce86312e tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:44.003948 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a62d21ad-0331-43bf-828d-62d6ce86312e tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:44.011290 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a62d21ad-0331-43bf-828d-62d6ce86312e tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:44.011739 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a62d21ad-0331-43bf-828d-62d6ce86312e tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:44.012535 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a62d21ad-0331-43bf-828d-62d6ce86312e tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:44.013032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a62d21ad-0331-43bf-828d-62d6ce86312e tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:44.158367 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a62d21ad-0331-43bf-828d-62d6ce86312e tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:44.172956 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a62d21ad-0331-43bf-828d-62d6ce86312e tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1501 microversion: 2.1 time: 0.170449 May 19 12:18:44.172956 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 57/103] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:43 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1501 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:44.240858 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-47220674-4e2d-4cb7-8df7-c237ac54a5a6 req-7e6ff552-41ea-40f8-8c66-a23066833476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b605d4a3-bf90-430f-b2c7-d037b473d29d", "name": "network-vif-plugged", "status": "completed", "tag": "d6fddd4a-6f06-4062-86e2-9b793547996c"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:18:44.268231 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-47220674-4e2d-4cb7-8df7-c237ac54a5a6 req-7e6ff552-41ea-40f8-8c66-a23066833476 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:44.268696 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-47220674-4e2d-4cb7-8df7-c237ac54a5a6 req-7e6ff552-41ea-40f8-8c66-a23066833476 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:44.293480 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-47220674-4e2d-4cb7-8df7-c237ac54a5a6 req-7e6ff552-41ea-40f8-8c66-a23066833476 service nova] Creating event network-vif-plugged:d6fddd4a-6f06-4062-86e2-9b793547996c for instance b605d4a3-bf90-430f-b2c7-d037b473d29d on hv-cinder-80475 May 19 12:18:44.310896 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-47220674-4e2d-4cb7-8df7-c237ac54a5a6 req-7e6ff552-41ea-40f8-8c66-a23066833476 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073819 May 19 12:18:44.314896 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 47/104] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:18:44.457203 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-98e2e55a-ad0c-46da-ad6b-d57f5a8353a7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:44.467172 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-98e2e55a-ad0c-46da-ad6b-d57f5a8353a7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:44.474323 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98e2e55a-ad0c-46da-ad6b-d57f5a8353a7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:44.475032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98e2e55a-ad0c-46da-ad6b-d57f5a8353a7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:44.476343 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98e2e55a-ad0c-46da-ad6b-d57f5a8353a7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:44.478303 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98e2e55a-ad0c-46da-ad6b-d57f5a8353a7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:44.534563 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-1ca5f6ec-2b55-4d66-a97f-1bc685636efb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:44.535591 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-1ca5f6ec-2b55-4d66-a97f-1bc685636efb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:44.543047 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1ca5f6ec-2b55-4d66-a97f-1bc685636efb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:44.543696 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1ca5f6ec-2b55-4d66-a97f-1bc685636efb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:44.544767 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1ca5f6ec-2b55-4d66-a97f-1bc685636efb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:44.545372 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1ca5f6ec-2b55-4d66-a97f-1bc685636efb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:44.716422 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-98e2e55a-ad0c-46da-ad6b-d57f5a8353a7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:44.724610 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-98e2e55a-ad0c-46da-ad6b-d57f5a8353a7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.272219 May 19 12:18:44.725115 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 58/105] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:44 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:44.742140 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-1ca5f6ec-2b55-4d66-a97f-1bc685636efb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:44.750173 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-1ca5f6ec-2b55-4d66-a97f-1bc685636efb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.220149 May 19 12:18:44.750749 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 48/106] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:44 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:44.819248 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-153fbf33-d576-45f9-a1e1-76049944e835 req-7ca68d56-e501-4d50-8280-cb678fafbe19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51363d7f-7d31-427b-87c1-fa437e713d85", "tag": "a5bc79ff-3cb4-40ee-b6c7-d0520edd0a76"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:18:44.824324 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-22937d63-8c59-45c2-90d9-6226a58bb3a4 req-f98e0978-b557-4f37-8656-308d3be2bbba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68e76015-a6d8-4580-a1ab-4a11f42cb6f0", "tag": "0269a249-9630-404e-8eb1-a23ce804a3bd"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:18:44.833468 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-153fbf33-d576-45f9-a1e1-76049944e835 req-7ca68d56-e501-4d50-8280-cb678fafbe19 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:44.837793 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-153fbf33-d576-45f9-a1e1-76049944e835 req-7ca68d56-e501-4d50-8280-cb678fafbe19 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:44.841119 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-22937d63-8c59-45c2-90d9-6226a58bb3a4 req-f98e0978-b557-4f37-8656-308d3be2bbba service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:44.841587 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-22937d63-8c59-45c2-90d9-6226a58bb3a4 req-f98e0978-b557-4f37-8656-308d3be2bbba service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:44.874395 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-22937d63-8c59-45c2-90d9-6226a58bb3a4 req-f98e0978-b557-4f37-8656-308d3be2bbba service nova] Creating event network-changed:0269a249-9630-404e-8eb1-a23ce804a3bd for instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 on hv-cinder-80475 May 19 12:18:44.874497 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-153fbf33-d576-45f9-a1e1-76049944e835 req-7ca68d56-e501-4d50-8280-cb678fafbe19 service nova] Creating event network-changed:a5bc79ff-3cb4-40ee-b6c7-d0520edd0a76 for instance 51363d7f-7d31-427b-87c1-fa437e713d85 on hv-cinder-80475 May 19 12:18:44.886555 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-22937d63-8c59-45c2-90d9-6226a58bb3a4 req-f98e0978-b557-4f37-8656-308d3be2bbba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076643 May 19 12:18:44.889159 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 59/107] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:18:44.892470 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-153fbf33-d576-45f9-a1e1-76049944e835 req-7ca68d56-e501-4d50-8280-cb678fafbe19 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076527 May 19 12:18:44.900618 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 49/108] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:18:44.904823 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ca665e3d-2c77-4008-ad08-48639bd87bcf tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:44.905601 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ca665e3d-2c77-4008-ad08-48639bd87bcf tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:44.913025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ca665e3d-2c77-4008-ad08-48639bd87bcf tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:44.913624 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ca665e3d-2c77-4008-ad08-48639bd87bcf tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:44.914586 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ca665e3d-2c77-4008-ad08-48639bd87bcf tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:44.915158 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ca665e3d-2c77-4008-ad08-48639bd87bcf tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:45.097977 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ca665e3d-2c77-4008-ad08-48639bd87bcf tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:45.106725 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ca665e3d-2c77-4008-ad08-48639bd87bcf tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.216268 May 19 12:18:45.116068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 60/109] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:44 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:45.744976 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-1f41e508-971e-4307-a1d4-928852d0d653 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:45.745671 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-1f41e508-971e-4307-a1d4-928852d0d653 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:45.752431 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1f41e508-971e-4307-a1d4-928852d0d653 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:45.752881 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1f41e508-971e-4307-a1d4-928852d0d653 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:45.753645 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1f41e508-971e-4307-a1d4-928852d0d653 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:45.754077 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1f41e508-971e-4307-a1d4-928852d0d653 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:45.769969 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-96f77117-e43f-4712-b7b7-4b705bd7c82d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:45.771526 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-96f77117-e43f-4712-b7b7-4b705bd7c82d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:45.779071 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-96f77117-e43f-4712-b7b7-4b705bd7c82d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:45.779517 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-96f77117-e43f-4712-b7b7-4b705bd7c82d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:45.782748 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-96f77117-e43f-4712-b7b7-4b705bd7c82d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:45.782748 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-96f77117-e43f-4712-b7b7-4b705bd7c82d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:45.989588 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-1f41e508-971e-4307-a1d4-928852d0d653 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:45.997337 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-1f41e508-971e-4307-a1d4-928852d0d653 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.258514 May 19 12:18:45.998022 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 50/110] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:45 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:46.016415 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-96f77117-e43f-4712-b7b7-4b705bd7c82d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:46.028839 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-96f77117-e43f-4712-b7b7-4b705bd7c82d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.263367 May 19 12:18:46.029446 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 61/111] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:45 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:46.126239 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f27c3ebd-54e1-46fa-815b-f1163624d701 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:46.126905 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f27c3ebd-54e1-46fa-815b-f1163624d701 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:46.134906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f27c3ebd-54e1-46fa-815b-f1163624d701 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:46.135391 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f27c3ebd-54e1-46fa-815b-f1163624d701 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:46.136215 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f27c3ebd-54e1-46fa-815b-f1163624d701 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:46.136652 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f27c3ebd-54e1-46fa-815b-f1163624d701 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:46.284969 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f27c3ebd-54e1-46fa-815b-f1163624d701 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:46.293208 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f27c3ebd-54e1-46fa-815b-f1163624d701 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.172735 May 19 12:18:46.293776 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 51/112] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:46 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:47.015133 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-06922967-f6c9-435d-850c-55b885de221c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:47.015937 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-06922967-f6c9-435d-850c-55b885de221c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:47.022413 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-06922967-f6c9-435d-850c-55b885de221c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:47.023142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-06922967-f6c9-435d-850c-55b885de221c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:47.024580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-06922967-f6c9-435d-850c-55b885de221c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:47.025090 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-06922967-f6c9-435d-850c-55b885de221c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:47.046424 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-211d87fc-fc99-48e1-8186-d070c60222dc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:47.047209 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-211d87fc-fc99-48e1-8186-d070c60222dc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:47.053554 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-211d87fc-fc99-48e1-8186-d070c60222dc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:47.054568 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-211d87fc-fc99-48e1-8186-d070c60222dc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:47.055393 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-211d87fc-fc99-48e1-8186-d070c60222dc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:47.055851 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-211d87fc-fc99-48e1-8186-d070c60222dc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:47.243392 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-06922967-f6c9-435d-850c-55b885de221c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:47.251600 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-06922967-f6c9-435d-850c-55b885de221c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.240272 May 19 12:18:47.252261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 62/113] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:47 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:47.258855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-211d87fc-fc99-48e1-8186-d070c60222dc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:47.271412 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-211d87fc-fc99-48e1-8186-d070c60222dc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.229254 May 19 12:18:47.272030 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 52/114] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:47 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:47.310814 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-97b3c6ae-b1b9-49d8-99e2-abb43206074d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:47.311445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-97b3c6ae-b1b9-49d8-99e2-abb43206074d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:47.319133 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-97b3c6ae-b1b9-49d8-99e2-abb43206074d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:47.319584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-97b3c6ae-b1b9-49d8-99e2-abb43206074d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:47.320780 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-97b3c6ae-b1b9-49d8-99e2-abb43206074d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:47.321220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-97b3c6ae-b1b9-49d8-99e2-abb43206074d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:47.464050 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-97b3c6ae-b1b9-49d8-99e2-abb43206074d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:47.471647 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-97b3c6ae-b1b9-49d8-99e2-abb43206074d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.164587 May 19 12:18:47.472253 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 63/115] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:47 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:48.279368 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-326ae887-d420-4a9b-b505-83e82c50ca8c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:48.284254 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-326ae887-d420-4a9b-b505-83e82c50ca8c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:48.287658 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-326ae887-d420-4a9b-b505-83e82c50ca8c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:48.288142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-326ae887-d420-4a9b-b505-83e82c50ca8c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:48.288284 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1976a83a-992e-44d6-926e-6a35cb4d5637 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:48.289320 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-326ae887-d420-4a9b-b505-83e82c50ca8c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:48.289594 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1976a83a-992e-44d6-926e-6a35cb4d5637 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:48.289958 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-326ae887-d420-4a9b-b505-83e82c50ca8c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:48.296195 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1976a83a-992e-44d6-926e-6a35cb4d5637 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:48.296646 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1976a83a-992e-44d6-926e-6a35cb4d5637 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:48.297433 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1976a83a-992e-44d6-926e-6a35cb4d5637 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:48.297869 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1976a83a-992e-44d6-926e-6a35cb4d5637 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:48.497769 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-326ae887-d420-4a9b-b505-83e82c50ca8c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:48.505634 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-326ae887-d420-4a9b-b505-83e82c50ca8c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.231091 May 19 12:18:48.506079 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1976a83a-992e-44d6-926e-6a35cb4d5637 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:48.520254 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 53/116] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:48 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:48.520254 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0f3c3e6b-3b63-45ee-8e13-fbd52505f9ff tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:48.520254 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0f3c3e6b-3b63-45ee-8e13-fbd52505f9ff tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:48.520927 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1976a83a-992e-44d6-926e-6a35cb4d5637 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.232080 May 19 12:18:48.521774 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0f3c3e6b-3b63-45ee-8e13-fbd52505f9ff tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:48.522410 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0f3c3e6b-3b63-45ee-8e13-fbd52505f9ff tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:48.523348 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0f3c3e6b-3b63-45ee-8e13-fbd52505f9ff tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:48.524026 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0f3c3e6b-3b63-45ee-8e13-fbd52505f9ff tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:48.524744 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 64/117] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:48 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:48.661535 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-0f3c3e6b-3b63-45ee-8e13-fbd52505f9ff tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:48.665261 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=100 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:48.670676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0f3c3e6b-3b63-45ee-8e13-fbd52505f9ff tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.163228 May 19 12:18:48.671259 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 54/118] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:48 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:49.531231 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e902eaf0-5c31-433e-80d8-d26b4170aa1c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:49.532063 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e902eaf0-5c31-433e-80d8-d26b4170aa1c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:49.534206 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-77ed9bfa-ef0c-4f76-b7b8-b80814bc16af tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:49.534825 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-77ed9bfa-ef0c-4f76-b7b8-b80814bc16af tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:49.538198 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e902eaf0-5c31-433e-80d8-d26b4170aa1c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:49.539144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e902eaf0-5c31-433e-80d8-d26b4170aa1c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:49.540582 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e902eaf0-5c31-433e-80d8-d26b4170aa1c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:49.541025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e902eaf0-5c31-433e-80d8-d26b4170aa1c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:49.542250 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-77ed9bfa-ef0c-4f76-b7b8-b80814bc16af tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:49.542705 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-77ed9bfa-ef0c-4f76-b7b8-b80814bc16af tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:49.543472 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-77ed9bfa-ef0c-4f76-b7b8-b80814bc16af tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:49.544005 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-77ed9bfa-ef0c-4f76-b7b8-b80814bc16af tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:49.776165 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-77ed9bfa-ef0c-4f76-b7b8-b80814bc16af tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:49.780345 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e902eaf0-5c31-433e-80d8-d26b4170aa1c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:49.784340 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-77ed9bfa-ef0c-4f76-b7b8-b80814bc16af tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.254902 May 19 12:18:49.784931 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 55/119] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:49 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:49.787917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e902eaf0-5c31-433e-80d8-d26b4170aa1c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.260635 May 19 12:18:49.791936 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c897d402-32e0-4a10-a5ef-bcedcebaa693 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:49.792696 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c897d402-32e0-4a10-a5ef-bcedcebaa693 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:49.795953 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:49.797660 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 65/120] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:49 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:49.799666 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c897d402-32e0-4a10-a5ef-bcedcebaa693 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:49.800159 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c897d402-32e0-4a10-a5ef-bcedcebaa693 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:49.800930 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c897d402-32e0-4a10-a5ef-bcedcebaa693 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:49.801366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c897d402-32e0-4a10-a5ef-bcedcebaa693 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:49.952548 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c897d402-32e0-4a10-a5ef-bcedcebaa693 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:49.961241 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c897d402-32e0-4a10-a5ef-bcedcebaa693 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.174256 May 19 12:18:49.961970 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 56/121] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:49 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:50.802573 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5ccb3683-c3a2-49bb-b22b-ed30ce78ac13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:50.803409 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5ccb3683-c3a2-49bb-b22b-ed30ce78ac13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:50.804578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e23838b5-4a55-4c4e-bd57-07e3103c48c0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:50.805231 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e23838b5-4a55-4c4e-bd57-07e3103c48c0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:50.810361 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ccb3683-c3a2-49bb-b22b-ed30ce78ac13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:50.810818 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ccb3683-c3a2-49bb-b22b-ed30ce78ac13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:50.811476 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e23838b5-4a55-4c4e-bd57-07e3103c48c0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:50.811654 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ccb3683-c3a2-49bb-b22b-ed30ce78ac13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:50.811960 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e23838b5-4a55-4c4e-bd57-07e3103c48c0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:50.812113 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ccb3683-c3a2-49bb-b22b-ed30ce78ac13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:50.812713 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e23838b5-4a55-4c4e-bd57-07e3103c48c0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:50.813143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e23838b5-4a55-4c4e-bd57-07e3103c48c0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:51.029663 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5ccb3683-c3a2-49bb-b22b-ed30ce78ac13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:51.033053 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e23838b5-4a55-4c4e-bd57-07e3103c48c0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:51.037325 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5ccb3683-c3a2-49bb-b22b-ed30ce78ac13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.238574 May 19 12:18:51.038040 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 66/122] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:50 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:51.042410 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e23838b5-4a55-4c4e-bd57-07e3103c48c0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.241679 May 19 12:18:51.043047 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 57/123] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:50 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:51.047019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9e7cb246-5cf4-43f4-a049-d28266f58c93 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:51.047633 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9e7cb246-5cf4-43f4-a049-d28266f58c93 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:51.054109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9e7cb246-5cf4-43f4-a049-d28266f58c93 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:51.054562 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9e7cb246-5cf4-43f4-a049-d28266f58c93 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:51.055322 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9e7cb246-5cf4-43f4-a049-d28266f58c93 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:51.055764 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9e7cb246-5cf4-43f4-a049-d28266f58c93 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:51.190762 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9e7cb246-5cf4-43f4-a049-d28266f58c93 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:51.199683 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9e7cb246-5cf4-43f4-a049-d28266f58c93 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.160567 May 19 12:18:51.200308 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 67/124] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:51 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:52.056733 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d2d8adc8-4c96-435d-b515-a40bece75cfa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:52.057349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d2d8adc8-4c96-435d-b515-a40bece75cfa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:52.060454 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1171b75e-fdcb-408c-a384-727e757b5e73 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:52.061235 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1171b75e-fdcb-408c-a384-727e757b5e73 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:52.064068 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d2d8adc8-4c96-435d-b515-a40bece75cfa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:52.064532 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d2d8adc8-4c96-435d-b515-a40bece75cfa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:52.065313 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d2d8adc8-4c96-435d-b515-a40bece75cfa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:52.065767 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d2d8adc8-4c96-435d-b515-a40bece75cfa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:52.071940 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1171b75e-fdcb-408c-a384-727e757b5e73 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:52.072972 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1171b75e-fdcb-408c-a384-727e757b5e73 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:52.074435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1171b75e-fdcb-408c-a384-727e757b5e73 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:52.075329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1171b75e-fdcb-408c-a384-727e757b5e73 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:52.079988 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:52.287661 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d2d8adc8-4c96-435d-b515-a40bece75cfa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:52.293545 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1171b75e-fdcb-408c-a384-727e757b5e73 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:52.296681 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d2d8adc8-4c96-435d-b515-a40bece75cfa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.244625 May 19 12:18:52.298894 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 58/125] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:52 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:52.301974 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-88334042-104b-4f94-84e5-b54f0527cd10 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:52.302584 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-88334042-104b-4f94-84e5-b54f0527cd10 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:52.302818 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1171b75e-fdcb-408c-a384-727e757b5e73 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.246147 May 19 12:18:52.310131 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-88334042-104b-4f94-84e5-b54f0527cd10 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:52.310583 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-88334042-104b-4f94-84e5-b54f0527cd10 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:52.311355 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-88334042-104b-4f94-84e5-b54f0527cd10 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:52.311805 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-88334042-104b-4f94-84e5-b54f0527cd10 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:52.314505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 68/126] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:52 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:52.452540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-88334042-104b-4f94-84e5-b54f0527cd10 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:52.460210 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-88334042-104b-4f94-84e5-b54f0527cd10 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.161792 May 19 12:18:52.460721 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 59/127] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:52 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:53.317341 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a48b4051-d440-4d23-8b3d-8c53ed048bea tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:53.318499 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a48b4051-d440-4d23-8b3d-8c53ed048bea tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:53.321635 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:53.322078 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c62c60e5-3f6a-47b1-b044-99c5156f74dc tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:53.322690 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c62c60e5-3f6a-47b1-b044-99c5156f74dc tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:53.329396 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c62c60e5-3f6a-47b1-b044-99c5156f74dc tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:53.329846 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c62c60e5-3f6a-47b1-b044-99c5156f74dc tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:53.330613 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c62c60e5-3f6a-47b1-b044-99c5156f74dc tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:53.330828 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a48b4051-d440-4d23-8b3d-8c53ed048bea tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:53.331099 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c62c60e5-3f6a-47b1-b044-99c5156f74dc tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:53.331672 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a48b4051-d440-4d23-8b3d-8c53ed048bea tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:53.361550 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a48b4051-d440-4d23-8b3d-8c53ed048bea tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:53.361550 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a48b4051-d440-4d23-8b3d-8c53ed048bea tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:53.548392 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c62c60e5-3f6a-47b1-b044-99c5156f74dc tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:53.560690 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c62c60e5-3f6a-47b1-b044-99c5156f74dc tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.242383 May 19 12:18:53.561375 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 60/128] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:53 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:53.566361 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d072c2bf-e8bd-4e53-9521-fa235ddc482e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:53.567065 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d072c2bf-e8bd-4e53-9521-fa235ddc482e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:53.574752 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d072c2bf-e8bd-4e53-9521-fa235ddc482e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:53.575293 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d072c2bf-e8bd-4e53-9521-fa235ddc482e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:53.576195 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d072c2bf-e8bd-4e53-9521-fa235ddc482e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:53.576632 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d072c2bf-e8bd-4e53-9521-fa235ddc482e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:53.580098 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a48b4051-d440-4d23-8b3d-8c53ed048bea tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:53.589558 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a48b4051-d440-4d23-8b3d-8c53ed048bea tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.278592 May 19 12:18:53.590134 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 69/129] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:53 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:53.727001 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d072c2bf-e8bd-4e53-9521-fa235ddc482e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:53.734915 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d072c2bf-e8bd-4e53-9521-fa235ddc482e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.172246 May 19 12:18:53.735499 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 61/130] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:53 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:54.577856 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-29093838-9b5e-4125-8873-36ba0c59101e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:54.578371 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-29093838-9b5e-4125-8873-36ba0c59101e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:54.584872 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-29093838-9b5e-4125-8873-36ba0c59101e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:54.585397 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-29093838-9b5e-4125-8873-36ba0c59101e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:54.586405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-29093838-9b5e-4125-8873-36ba0c59101e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:54.586858 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-29093838-9b5e-4125-8873-36ba0c59101e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:54.607429 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5f5377fc-3e82-4f42-b809-ba70c5630baa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:54.608065 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5f5377fc-3e82-4f42-b809-ba70c5630baa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:54.614129 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5f5377fc-3e82-4f42-b809-ba70c5630baa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:54.614569 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5f5377fc-3e82-4f42-b809-ba70c5630baa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:54.615339 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5f5377fc-3e82-4f42-b809-ba70c5630baa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:54.615770 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5f5377fc-3e82-4f42-b809-ba70c5630baa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:54.963276 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-29093838-9b5e-4125-8873-36ba0c59101e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:54.974955 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-29093838-9b5e-4125-8873-36ba0c59101e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.400530 May 19 12:18:54.976593 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 70/131] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:54 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:54.985571 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d0cb857d-8be6-46df-aa24-d994395cf7d9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:54.986714 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d0cb857d-8be6-46df-aa24-d994395cf7d9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:54.990101 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5f5377fc-3e82-4f42-b809-ba70c5630baa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:54.998831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d0cb857d-8be6-46df-aa24-d994395cf7d9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:54.999033 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5f5377fc-3e82-4f42-b809-ba70c5630baa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.396005 May 19 12:18:54.999540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 62/132] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:54 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:55.000127 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d0cb857d-8be6-46df-aa24-d994395cf7d9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:55.001718 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d0cb857d-8be6-46df-aa24-d994395cf7d9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:55.002473 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d0cb857d-8be6-46df-aa24-d994395cf7d9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:55.165759 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d0cb857d-8be6-46df-aa24-d994395cf7d9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:55.180381 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d0cb857d-8be6-46df-aa24-d994395cf7d9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.201641 May 19 12:18:55.181501 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 71/133] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:54 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:55.993858 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-91c92bf1-07c7-415c-91d5-5ba4c56bf96a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:55.994475 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-91c92bf1-07c7-415c-91d5-5ba4c56bf96a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:56.000639 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-91c92bf1-07c7-415c-91d5-5ba4c56bf96a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:56.001085 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-91c92bf1-07c7-415c-91d5-5ba4c56bf96a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:56.001849 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-91c92bf1-07c7-415c-91d5-5ba4c56bf96a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:56.002277 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-91c92bf1-07c7-415c-91d5-5ba4c56bf96a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:56.015879 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e092f13a-59ed-4598-a0d5-8368055ed501 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:56.016667 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e092f13a-59ed-4598-a0d5-8368055ed501 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:56.023632 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e092f13a-59ed-4598-a0d5-8368055ed501 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:56.024222 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e092f13a-59ed-4598-a0d5-8368055ed501 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:56.025072 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e092f13a-59ed-4598-a0d5-8368055ed501 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:56.025583 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e092f13a-59ed-4598-a0d5-8368055ed501 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:56.216028 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-91c92bf1-07c7-415c-91d5-5ba4c56bf96a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:56.218450 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e092f13a-59ed-4598-a0d5-8368055ed501 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:56.219987 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-91c92bf1-07c7-415c-91d5-5ba4c56bf96a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.230348 May 19 12:18:56.220997 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 63/134] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:55 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:56.228153 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e092f13a-59ed-4598-a0d5-8368055ed501 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.215594 May 19 12:18:56.233833 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 72/135] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:56 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:56.234037 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a4d52d20-01f4-4deb-b7b5-4846095e3cc9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:56.234037 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a4d52d20-01f4-4deb-b7b5-4846095e3cc9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:56.250393 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a4d52d20-01f4-4deb-b7b5-4846095e3cc9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:56.251041 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a4d52d20-01f4-4deb-b7b5-4846095e3cc9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:56.252424 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a4d52d20-01f4-4deb-b7b5-4846095e3cc9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:56.255109 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a4d52d20-01f4-4deb-b7b5-4846095e3cc9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:56.397292 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a4d52d20-01f4-4deb-b7b5-4846095e3cc9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:56.405695 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a4d52d20-01f4-4deb-b7b5-4846095e3cc9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.183568 May 19 12:18:56.406350 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 64/136] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:56 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:57.271356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3ca24c27-c9b6-4c6b-b7c8-e9098da719ff tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:57.271356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3ca24c27-c9b6-4c6b-b7c8-e9098da719ff tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:57.273492 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-12cc612e-24e3-420b-95f0-d3ddafa593fc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:57.273492 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-12cc612e-24e3-420b-95f0-d3ddafa593fc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:57.274312 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3ca24c27-c9b6-4c6b-b7c8-e9098da719ff tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:57.274312 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3ca24c27-c9b6-4c6b-b7c8-e9098da719ff tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:57.274312 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3ca24c27-c9b6-4c6b-b7c8-e9098da719ff tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:57.274312 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3ca24c27-c9b6-4c6b-b7c8-e9098da719ff tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:57.274699 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-12cc612e-24e3-420b-95f0-d3ddafa593fc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:57.274699 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-12cc612e-24e3-420b-95f0-d3ddafa593fc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:57.274699 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-12cc612e-24e3-420b-95f0-d3ddafa593fc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:57.274699 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-12cc612e-24e3-420b-95f0-d3ddafa593fc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:57.519030 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-12cc612e-24e3-420b-95f0-d3ddafa593fc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:57.526994 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3ca24c27-c9b6-4c6b-b7c8-e9098da719ff tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:57.528160 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-12cc612e-24e3-420b-95f0-d3ddafa593fc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1322 microversion: 2.1 time: 0.285808 May 19 12:18:57.539281 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 65/137] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:57 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:57.539281 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d569bcc3-3ce6-4589-b8f1-19ce9b416740 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:57.539281 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d569bcc3-3ce6-4589-b8f1-19ce9b416740 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:57.548150 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3ca24c27-c9b6-4c6b-b7c8-e9098da719ff tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.297184 May 19 12:18:57.548150 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 73/138] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:57 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:57.548335 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d569bcc3-3ce6-4589-b8f1-19ce9b416740 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:57.548335 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d569bcc3-3ce6-4589-b8f1-19ce9b416740 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:57.548335 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d569bcc3-3ce6-4589-b8f1-19ce9b416740 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:57.548335 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d569bcc3-3ce6-4589-b8f1-19ce9b416740 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:57.684015 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d569bcc3-3ce6-4589-b8f1-19ce9b416740 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:57.691678 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d569bcc3-3ce6-4589-b8f1-19ce9b416740 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.161736 May 19 12:18:57.692339 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 66/139] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:57 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:58.558968 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ec46c77b-eee7-4ef5-bfac-25d851311f1d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:58.559559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a224d750-31f0-4965-84ad-dba96f3febc2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:58.559964 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a224d750-31f0-4965-84ad-dba96f3febc2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:58.560389 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ec46c77b-eee7-4ef5-bfac-25d851311f1d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:58.566219 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a224d750-31f0-4965-84ad-dba96f3febc2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:58.566923 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a224d750-31f0-4965-84ad-dba96f3febc2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:58.567699 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a224d750-31f0-4965-84ad-dba96f3febc2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:58.568151 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a224d750-31f0-4965-84ad-dba96f3febc2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:58.572202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ec46c77b-eee7-4ef5-bfac-25d851311f1d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:58.572916 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ec46c77b-eee7-4ef5-bfac-25d851311f1d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:58.574327 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ec46c77b-eee7-4ef5-bfac-25d851311f1d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:58.575169 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ec46c77b-eee7-4ef5-bfac-25d851311f1d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:58.974494 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a224d750-31f0-4965-84ad-dba96f3febc2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:58.978281 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ec46c77b-eee7-4ef5-bfac-25d851311f1d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:58.982800 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a224d750-31f0-4965-84ad-dba96f3febc2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.428085 May 19 12:18:58.983386 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 67/140] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:58 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:18:58.986775 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ec46c77b-eee7-4ef5-bfac-25d851311f1d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1515 microversion: 2.1 time: 0.437258 May 19 12:18:58.987555 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 74/141] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:58 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1515 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:58.995521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9c12a4ec-8312-4849-aaa3-99d0c3d76197 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:58.996348 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9c12a4ec-8312-4849-aaa3-99d0c3d76197 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:59.005921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9c12a4ec-8312-4849-aaa3-99d0c3d76197 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:59.006368 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9c12a4ec-8312-4849-aaa3-99d0c3d76197 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:59.008362 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9c12a4ec-8312-4849-aaa3-99d0c3d76197 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:59.009050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9c12a4ec-8312-4849-aaa3-99d0c3d76197 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:59.009694 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a847a21b-167b-4cbc-963d-ede760f301fa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:18:59.011361 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a847a21b-167b-4cbc-963d-ede760f301fa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:59.020250 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a847a21b-167b-4cbc-963d-ede760f301fa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:59.020957 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a847a21b-167b-4cbc-963d-ede760f301fa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:59.022187 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a847a21b-167b-4cbc-963d-ede760f301fa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:59.022959 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a847a21b-167b-4cbc-963d-ede760f301fa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:59.108669 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-a847a21b-167b-4cbc-963d-ede760f301fa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lazy-loading 'flavor' on Instance uuid c735043f-0342-49b4-9be8-ee27f994a3ed {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:18:59.220362 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9c12a4ec-8312-4849-aaa3-99d0c3d76197 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:59.239528 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9c12a4ec-8312-4849-aaa3-99d0c3d76197 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.248119 May 19 12:18:59.239528 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 68/142] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:58 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:59.781038 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a847a21b-167b-4cbc-963d-ede760f301fa tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "POST /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed/action" status: 200 len: 32 microversion: 2.1 time: 0.779653 May 19 12:18:59.791282 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 75/143] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 19 12:18:58 2022] POST /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed/action => generated 32 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 12:18:59.791647 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c0f78f13-489f-45a9-93c8-d1babb63bd94 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:59.791647 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c0f78f13-489f-45a9-93c8-d1babb63bd94 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:18:59.797757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c0f78f13-489f-45a9-93c8-d1babb63bd94 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:59.798211 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c0f78f13-489f-45a9-93c8-d1babb63bd94 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:59.798973 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c0f78f13-489f-45a9-93c8-d1babb63bd94 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:18:59.799410 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c0f78f13-489f-45a9-93c8-d1babb63bd94 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:18:59.950631 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c0f78f13-489f-45a9-93c8-d1babb63bd94 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:18:59.960141 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c0f78f13-489f-45a9-93c8-d1babb63bd94 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.173132 May 19 12:18:59.960801 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 69/144] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:18:59 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:00.006573 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6097a630-4850-4a71-8a37-5b76b2daec77 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:00.007343 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6097a630-4850-4a71-8a37-5b76b2daec77 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:00.014105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6097a630-4850-4a71-8a37-5b76b2daec77 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:00.017170 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6097a630-4850-4a71-8a37-5b76b2daec77 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:00.017170 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6097a630-4850-4a71-8a37-5b76b2daec77 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:00.017170 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6097a630-4850-4a71-8a37-5b76b2daec77 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:00.232447 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6097a630-4850-4a71-8a37-5b76b2daec77 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:00.243464 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6097a630-4850-4a71-8a37-5b76b2daec77 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.241018 May 19 12:19:00.244188 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 76/145] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:00 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:00.267274 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-05d1acf0-2959-49cb-b956-4b73dab52248 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:00.268452 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-05d1acf0-2959-49cb-b956-4b73dab52248 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:00.278538 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-05d1acf0-2959-49cb-b956-4b73dab52248 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:00.279029 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-05d1acf0-2959-49cb-b956-4b73dab52248 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:00.279923 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-05d1acf0-2959-49cb-b956-4b73dab52248 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:00.280375 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-05d1acf0-2959-49cb-b956-4b73dab52248 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:00.426793 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-05d1acf0-2959-49cb-b956-4b73dab52248 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:00.435121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-05d1acf0-2959-49cb-b956-4b73dab52248 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.173128 May 19 12:19:00.435986 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 70/146] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:00 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:00.978753 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f75c1715-1855-4f7f-9050-4d6b158f519a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:00.979809 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f75c1715-1855-4f7f-9050-4d6b158f519a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:00.987159 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f75c1715-1855-4f7f-9050-4d6b158f519a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:00.987973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f75c1715-1855-4f7f-9050-4d6b158f519a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:00.994891 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f75c1715-1855-4f7f-9050-4d6b158f519a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:00.994891 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f75c1715-1855-4f7f-9050-4d6b158f519a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:01.261529 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f53b5b8c-f209-4e42-b712-406ed0d1c75e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:01.262403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f53b5b8c-f209-4e42-b712-406ed0d1c75e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:01.275837 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f53b5b8c-f209-4e42-b712-406ed0d1c75e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:01.276688 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f53b5b8c-f209-4e42-b712-406ed0d1c75e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:01.281273 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f53b5b8c-f209-4e42-b712-406ed0d1c75e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:01.284291 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f53b5b8c-f209-4e42-b712-406ed0d1c75e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:01.336915 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=100 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:01.395691 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f75c1715-1855-4f7f-9050-4d6b158f519a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:01.408769 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f75c1715-1855-4f7f-9050-4d6b158f519a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.434115 May 19 12:19:01.420362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 77/147] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:00 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:01.459143 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4e58362b-01c8-41ff-9e59-24918a753d77 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:01.460803 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4e58362b-01c8-41ff-9e59-24918a753d77 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:01.475574 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4e58362b-01c8-41ff-9e59-24918a753d77 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:01.478101 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4e58362b-01c8-41ff-9e59-24918a753d77 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:01.479608 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4e58362b-01c8-41ff-9e59-24918a753d77 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:01.480299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4e58362b-01c8-41ff-9e59-24918a753d77 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:01.529824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f53b5b8c-f209-4e42-b712-406ed0d1c75e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:01.542622 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f53b5b8c-f209-4e42-b712-406ed0d1c75e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.285853 May 19 12:19:01.552708 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 71/148] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:01 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:01.593621 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-169d48b7-6a96-4629-b840-f93f77691626 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77d941e2-f2b5-4723-b8fd-7a117d9d477b"}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:19:01.596304 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-169d48b7-6a96-4629-b840-f93f77691626 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:01.606661 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-169d48b7-6a96-4629-b840-f93f77691626 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:01.607127 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-169d48b7-6a96-4629-b840-f93f77691626 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:01.607942 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-169d48b7-6a96-4629-b840-f93f77691626 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:01.608560 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-169d48b7-6a96-4629-b840-f93f77691626 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:01.677892 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4e58362b-01c8-41ff-9e59-24918a753d77 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:01.690622 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4e58362b-01c8-41ff-9e59-24918a753d77 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.240172 May 19 12:19:01.691772 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 78/149] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:01 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:02.427986 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5800fbc4-c7b6-4b6e-b71f-87e923b7b3d1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:02.428653 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5800fbc4-c7b6-4b6e-b71f-87e923b7b3d1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:02.435608 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5800fbc4-c7b6-4b6e-b71f-87e923b7b3d1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:02.436144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5800fbc4-c7b6-4b6e-b71f-87e923b7b3d1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:02.436855 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5800fbc4-c7b6-4b6e-b71f-87e923b7b3d1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:02.437406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5800fbc4-c7b6-4b6e-b71f-87e923b7b3d1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:02.567468 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5800fbc4-c7b6-4b6e-b71f-87e923b7b3d1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:02.575279 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5800fbc4-c7b6-4b6e-b71f-87e923b7b3d1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.151241 May 19 12:19:02.575866 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 79/150] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:02 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:02.580266 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d4cb03a3-b624-41ae-940a-64b8d6c7aa8a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:02.580869 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d4cb03a3-b624-41ae-940a-64b8d6c7aa8a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:02.588115 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d4cb03a3-b624-41ae-940a-64b8d6c7aa8a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:02.588499 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d4cb03a3-b624-41ae-940a-64b8d6c7aa8a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:02.589296 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d4cb03a3-b624-41ae-940a-64b8d6c7aa8a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:02.589726 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d4cb03a3-b624-41ae-940a-64b8d6c7aa8a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:02.734854 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d4cb03a3-b624-41ae-940a-64b8d6c7aa8a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:02.743001 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d4cb03a3-b624-41ae-940a-64b8d6c7aa8a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.166060 May 19 12:19:02.743597 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 80/151] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:02 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:02.748355 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5694a839-e584-4ad6-94b3-9364f624ecf5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:02.748980 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5694a839-e584-4ad6-94b3-9364f624ecf5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:02.755490 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5694a839-e584-4ad6-94b3-9364f624ecf5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:02.755983 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5694a839-e584-4ad6-94b3-9364f624ecf5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:02.756770 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5694a839-e584-4ad6-94b3-9364f624ecf5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:02.757249 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5694a839-e584-4ad6-94b3-9364f624ecf5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:03.072248 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5694a839-e584-4ad6-94b3-9364f624ecf5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:03.080080 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5694a839-e584-4ad6-94b3-9364f624ecf5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.335393 May 19 12:19:03.080665 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 81/152] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:02 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:03.593730 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7ec77236-9a8e-4015-92f0-6143d3d7126b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:03.594346 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7ec77236-9a8e-4015-92f0-6143d3d7126b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:03.603020 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7ec77236-9a8e-4015-92f0-6143d3d7126b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:03.603345 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7ec77236-9a8e-4015-92f0-6143d3d7126b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:03.604309 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7ec77236-9a8e-4015-92f0-6143d3d7126b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:03.605036 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7ec77236-9a8e-4015-92f0-6143d3d7126b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:03.747306 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7ec77236-9a8e-4015-92f0-6143d3d7126b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:03.749758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:03.755744 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7ec77236-9a8e-4015-92f0-6143d3d7126b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.166086 May 19 12:19:03.756351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 82/153] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:03 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:03.761905 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d8d06ec5-933d-4c44-b108-fb432a9b5708 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:03.762523 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d8d06ec5-933d-4c44-b108-fb432a9b5708 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:03.769264 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d8d06ec5-933d-4c44-b108-fb432a9b5708 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:03.769722 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d8d06ec5-933d-4c44-b108-fb432a9b5708 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:03.770501 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d8d06ec5-933d-4c44-b108-fb432a9b5708 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:03.770936 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d8d06ec5-933d-4c44-b108-fb432a9b5708 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:03.925164 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d8d06ec5-933d-4c44-b108-fb432a9b5708 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:03.933164 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d8d06ec5-933d-4c44-b108-fb432a9b5708 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.175758 May 19 12:19:03.934309 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 83/154] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:03 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:04.098150 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1af5caa9-04cd-4a0c-b06a-2d96032d552d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:04.098823 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1af5caa9-04cd-4a0c-b06a-2d96032d552d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:04.105924 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1af5caa9-04cd-4a0c-b06a-2d96032d552d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:04.106377 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1af5caa9-04cd-4a0c-b06a-2d96032d552d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:04.107149 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1af5caa9-04cd-4a0c-b06a-2d96032d552d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:04.107593 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1af5caa9-04cd-4a0c-b06a-2d96032d552d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:04.239556 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1af5caa9-04cd-4a0c-b06a-2d96032d552d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:04.247861 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1af5caa9-04cd-4a0c-b06a-2d96032d552d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.153851 May 19 12:19:04.248431 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 84/155] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:04 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:04.774017 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c85b4922-ccf4-47a0-8f52-ac9f1d8b8dea tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:04.774629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c85b4922-ccf4-47a0-8f52-ac9f1d8b8dea tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:04.780709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c85b4922-ccf4-47a0-8f52-ac9f1d8b8dea tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:04.781164 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c85b4922-ccf4-47a0-8f52-ac9f1d8b8dea tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:04.781941 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c85b4922-ccf4-47a0-8f52-ac9f1d8b8dea tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:04.782369 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c85b4922-ccf4-47a0-8f52-ac9f1d8b8dea tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:04.914960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c85b4922-ccf4-47a0-8f52-ac9f1d8b8dea tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:04.922749 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c85b4922-ccf4-47a0-8f52-ac9f1d8b8dea tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.153298 May 19 12:19:04.923316 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 85/156] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:04 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:04.950816 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0759a8f5-7acc-4044-84b1-a585d31bc423 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:04.951416 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0759a8f5-7acc-4044-84b1-a585d31bc423 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:04.957577 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0759a8f5-7acc-4044-84b1-a585d31bc423 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:04.958014 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0759a8f5-7acc-4044-84b1-a585d31bc423 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:04.958773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0759a8f5-7acc-4044-84b1-a585d31bc423 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:04.959201 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0759a8f5-7acc-4044-84b1-a585d31bc423 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:05.088462 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0759a8f5-7acc-4044-84b1-a585d31bc423 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:05.096232 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0759a8f5-7acc-4044-84b1-a585d31bc423 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.149179 May 19 12:19:05.096891 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 86/157] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:04 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:05.264764 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-25330325-dc97-4b9f-ad86-0f059f043ed8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:05.265366 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-25330325-dc97-4b9f-ad86-0f059f043ed8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:05.271471 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-25330325-dc97-4b9f-ad86-0f059f043ed8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:05.271955 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-25330325-dc97-4b9f-ad86-0f059f043ed8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:05.278108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-25330325-dc97-4b9f-ad86-0f059f043ed8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:05.278108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-25330325-dc97-4b9f-ad86-0f059f043ed8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:05.416542 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-25330325-dc97-4b9f-ad86-0f059f043ed8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:05.424324 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-25330325-dc97-4b9f-ad86-0f059f043ed8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.163304 May 19 12:19:05.424901 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 87/158] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:05 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:05.940786 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c63ce320-eaab-4773-813b-1370a9cefe57 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:05.941475 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c63ce320-eaab-4773-813b-1370a9cefe57 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:05.948829 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c63ce320-eaab-4773-813b-1370a9cefe57 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:05.949285 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c63ce320-eaab-4773-813b-1370a9cefe57 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:05.950087 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c63ce320-eaab-4773-813b-1370a9cefe57 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:05.950524 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c63ce320-eaab-4773-813b-1370a9cefe57 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:06.090598 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c63ce320-eaab-4773-813b-1370a9cefe57 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:06.098228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c63ce320-eaab-4773-813b-1370a9cefe57 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.161511 May 19 12:19:06.098809 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 88/159] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:05 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:06.113485 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-66951c06-9755-4e23-b1af-cce904254b6a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:06.114089 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-66951c06-9755-4e23-b1af-cce904254b6a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:06.120990 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66951c06-9755-4e23-b1af-cce904254b6a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:06.127006 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66951c06-9755-4e23-b1af-cce904254b6a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:06.127006 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66951c06-9755-4e23-b1af-cce904254b6a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:06.127006 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66951c06-9755-4e23-b1af-cce904254b6a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:06.257922 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-66951c06-9755-4e23-b1af-cce904254b6a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:06.265685 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-66951c06-9755-4e23-b1af-cce904254b6a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.155968 May 19 12:19:06.266267 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 89/160] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:06 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:06.442502 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-33587c1d-0ef8-4cd5-8236-e1db779802f4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:06.443131 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-33587c1d-0ef8-4cd5-8236-e1db779802f4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:06.450057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33587c1d-0ef8-4cd5-8236-e1db779802f4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:06.450384 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33587c1d-0ef8-4cd5-8236-e1db779802f4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:06.451160 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33587c1d-0ef8-4cd5-8236-e1db779802f4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:06.451589 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33587c1d-0ef8-4cd5-8236-e1db779802f4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:06.600101 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-33587c1d-0ef8-4cd5-8236-e1db779802f4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:06.609018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-33587c1d-0ef8-4cd5-8236-e1db779802f4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.170278 May 19 12:19:06.609610 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 90/161] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:06 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:07.117830 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2dcaf7ba-d548-4786-a11e-2f9493216dd5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:07.118991 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2dcaf7ba-d548-4786-a11e-2f9493216dd5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:07.125791 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2dcaf7ba-d548-4786-a11e-2f9493216dd5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:07.127658 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2dcaf7ba-d548-4786-a11e-2f9493216dd5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:07.127658 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2dcaf7ba-d548-4786-a11e-2f9493216dd5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:07.127658 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2dcaf7ba-d548-4786-a11e-2f9493216dd5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:07.269246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2dcaf7ba-d548-4786-a11e-2f9493216dd5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:07.279944 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2dcaf7ba-d548-4786-a11e-2f9493216dd5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.166936 May 19 12:19:07.280861 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 91/162] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:07 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:07.285706 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-42889b7b-0698-41a3-ae13-70fec684d5ce tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:07.286313 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-42889b7b-0698-41a3-ae13-70fec684d5ce tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:07.293267 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-42889b7b-0698-41a3-ae13-70fec684d5ce tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:07.293707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-42889b7b-0698-41a3-ae13-70fec684d5ce tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:07.294472 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-42889b7b-0698-41a3-ae13-70fec684d5ce tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:07.294934 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-42889b7b-0698-41a3-ae13-70fec684d5ce tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:07.437913 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-42889b7b-0698-41a3-ae13-70fec684d5ce tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:07.445842 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-42889b7b-0698-41a3-ae13-70fec684d5ce tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.163712 May 19 12:19:07.446424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 92/163] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:07 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:07.625543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f9b07c34-eeea-4afb-9223-bbef25e214b0 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:07.626151 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f9b07c34-eeea-4afb-9223-bbef25e214b0 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:07.632420 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f9b07c34-eeea-4afb-9223-bbef25e214b0 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:07.632806 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f9b07c34-eeea-4afb-9223-bbef25e214b0 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:07.633765 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f9b07c34-eeea-4afb-9223-bbef25e214b0 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:07.634192 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f9b07c34-eeea-4afb-9223-bbef25e214b0 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:07.766976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f9b07c34-eeea-4afb-9223-bbef25e214b0 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:07.775770 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f9b07c34-eeea-4afb-9223-bbef25e214b0 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.154032 May 19 12:19:07.776376 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 93/164] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:07 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:08.298199 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b543eea9-06b9-428b-9c37-24c8e3fabea6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:08.298846 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b543eea9-06b9-428b-9c37-24c8e3fabea6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:08.305740 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b543eea9-06b9-428b-9c37-24c8e3fabea6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:08.306378 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b543eea9-06b9-428b-9c37-24c8e3fabea6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:08.307150 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b543eea9-06b9-428b-9c37-24c8e3fabea6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:08.307587 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b543eea9-06b9-428b-9c37-24c8e3fabea6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:08.440441 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b543eea9-06b9-428b-9c37-24c8e3fabea6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:08.449193 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b543eea9-06b9-428b-9c37-24c8e3fabea6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.154942 May 19 12:19:08.449775 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 94/165] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:08 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:08.462832 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-89f97fc6-2197-41bd-bf33-1f0bf95a5acf tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:08.463556 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-89f97fc6-2197-41bd-bf33-1f0bf95a5acf tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:08.469822 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-89f97fc6-2197-41bd-bf33-1f0bf95a5acf tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:08.470196 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-89f97fc6-2197-41bd-bf33-1f0bf95a5acf tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:08.471045 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-89f97fc6-2197-41bd-bf33-1f0bf95a5acf tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:08.471478 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-89f97fc6-2197-41bd-bf33-1f0bf95a5acf tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:08.625139 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-89f97fc6-2197-41bd-bf33-1f0bf95a5acf tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:08.633578 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-89f97fc6-2197-41bd-bf33-1f0bf95a5acf tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.174001 May 19 12:19:08.634833 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 95/166] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:08 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:08.793094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a86c9490-8716-413c-ba20-22abec9fc97d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:08.793616 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a86c9490-8716-413c-ba20-22abec9fc97d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:08.799747 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a86c9490-8716-413c-ba20-22abec9fc97d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:08.800232 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a86c9490-8716-413c-ba20-22abec9fc97d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:08.800997 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a86c9490-8716-413c-ba20-22abec9fc97d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:08.801436 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a86c9490-8716-413c-ba20-22abec9fc97d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:08.941861 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a86c9490-8716-413c-ba20-22abec9fc97d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:08.950015 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a86c9490-8716-413c-ba20-22abec9fc97d tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.161134 May 19 12:19:08.951074 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 96/167] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:08 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:09.468503 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-35036ef6-bff9-46fc-82de-5caacb8c6425 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:09.469942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-35036ef6-bff9-46fc-82de-5caacb8c6425 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:09.478310 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-35036ef6-bff9-46fc-82de-5caacb8c6425 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:09.478712 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-35036ef6-bff9-46fc-82de-5caacb8c6425 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:09.479684 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-35036ef6-bff9-46fc-82de-5caacb8c6425 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:09.480134 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-35036ef6-bff9-46fc-82de-5caacb8c6425 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:09.635479 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-35036ef6-bff9-46fc-82de-5caacb8c6425 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:09.643299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-35036ef6-bff9-46fc-82de-5caacb8c6425 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.179196 May 19 12:19:09.644136 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 97/168] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:09 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:09.659230 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-99f57c5b-461d-4a17-b7ce-ac3a115fc9f2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:09.659885 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-99f57c5b-461d-4a17-b7ce-ac3a115fc9f2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:09.666734 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-99f57c5b-461d-4a17-b7ce-ac3a115fc9f2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:09.667194 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-99f57c5b-461d-4a17-b7ce-ac3a115fc9f2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:09.668022 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-99f57c5b-461d-4a17-b7ce-ac3a115fc9f2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:09.668481 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-99f57c5b-461d-4a17-b7ce-ac3a115fc9f2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:09.813440 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-99f57c5b-461d-4a17-b7ce-ac3a115fc9f2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:09.848391 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-99f57c5b-461d-4a17-b7ce-ac3a115fc9f2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.185566 May 19 12:19:09.849492 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 98/169] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:09 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:09.968283 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d902ed7c-8208-4cd4-b97d-9e05c2e72f17 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:09.968992 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d902ed7c-8208-4cd4-b97d-9e05c2e72f17 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:09.975163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d902ed7c-8208-4cd4-b97d-9e05c2e72f17 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:09.975609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d902ed7c-8208-4cd4-b97d-9e05c2e72f17 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:09.976644 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d902ed7c-8208-4cd4-b97d-9e05c2e72f17 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:09.977084 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d902ed7c-8208-4cd4-b97d-9e05c2e72f17 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:09.993407 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:10.139123 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d902ed7c-8208-4cd4-b97d-9e05c2e72f17 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:10.152175 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d902ed7c-8208-4cd4-b97d-9e05c2e72f17 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.187651 May 19 12:19:10.152754 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 99/170] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:09 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:10.661421 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8f0fb009-de64-4e64-8e49-3ccefd347b64 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:10.662086 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8f0fb009-de64-4e64-8e49-3ccefd347b64 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:10.669868 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8f0fb009-de64-4e64-8e49-3ccefd347b64 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:10.670318 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8f0fb009-de64-4e64-8e49-3ccefd347b64 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:10.671081 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8f0fb009-de64-4e64-8e49-3ccefd347b64 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:10.671511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8f0fb009-de64-4e64-8e49-3ccefd347b64 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:10.825477 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8f0fb009-de64-4e64-8e49-3ccefd347b64 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:10.836359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8f0fb009-de64-4e64-8e49-3ccefd347b64 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.177592 May 19 12:19:10.838322 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 100/171] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:10 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:10.866357 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-37de4283-cd59-487f-a48d-15559bb60fa9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:10.867395 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-37de4283-cd59-487f-a48d-15559bb60fa9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:10.874485 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-37de4283-cd59-487f-a48d-15559bb60fa9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:10.874934 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-37de4283-cd59-487f-a48d-15559bb60fa9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:10.875839 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-37de4283-cd59-487f-a48d-15559bb60fa9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:10.876441 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-37de4283-cd59-487f-a48d-15559bb60fa9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:11.043480 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-37de4283-cd59-487f-a48d-15559bb60fa9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:11.056079 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-37de4283-cd59-487f-a48d-15559bb60fa9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.192923 May 19 12:19:11.056079 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 101/172] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:10 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:11.169926 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a165699d-e3f5-4855-8d9b-3da51aaa6ad7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:11.170647 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a165699d-e3f5-4855-8d9b-3da51aaa6ad7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:11.178552 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a165699d-e3f5-4855-8d9b-3da51aaa6ad7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:11.182783 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a165699d-e3f5-4855-8d9b-3da51aaa6ad7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:11.182783 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a165699d-e3f5-4855-8d9b-3da51aaa6ad7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:11.182783 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a165699d-e3f5-4855-8d9b-3da51aaa6ad7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:11.338636 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a165699d-e3f5-4855-8d9b-3da51aaa6ad7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:11.348057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a165699d-e3f5-4855-8d9b-3da51aaa6ad7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.182572 May 19 12:19:11.348645 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 102/173] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:11 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:11.603702 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=33 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:11.746070 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=9 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:11.856857 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fc0884ac-266c-4eb2-87bf-d4fe21b4bd1f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:11.857697 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-fc0884ac-266c-4eb2-87bf-d4fe21b4bd1f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:11.865119 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fc0884ac-266c-4eb2-87bf-d4fe21b4bd1f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:11.865644 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fc0884ac-266c-4eb2-87bf-d4fe21b4bd1f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:11.868960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fc0884ac-266c-4eb2-87bf-d4fe21b4bd1f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:11.868960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fc0884ac-266c-4eb2-87bf-d4fe21b4bd1f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:12.074510 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fc0884ac-266c-4eb2-87bf-d4fe21b4bd1f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:12.082457 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fc0884ac-266c-4eb2-87bf-d4fe21b4bd1f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.231810 May 19 12:19:12.083034 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 103/174] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:11 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:12.088730 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-541bd430-bd2f-46b6-b52a-9eabbcff3719 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:12.089336 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-541bd430-bd2f-46b6-b52a-9eabbcff3719 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:12.095367 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-541bd430-bd2f-46b6-b52a-9eabbcff3719 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:12.098191 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-541bd430-bd2f-46b6-b52a-9eabbcff3719 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:12.098191 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-541bd430-bd2f-46b6-b52a-9eabbcff3719 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:12.098191 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-541bd430-bd2f-46b6-b52a-9eabbcff3719 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:12.278240 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-541bd430-bd2f-46b6-b52a-9eabbcff3719 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:12.285845 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-541bd430-bd2f-46b6-b52a-9eabbcff3719 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.201785 May 19 12:19:12.286435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 104/175] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:12 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:12.366088 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6bbd6dd5-5da7-4cb0-aba1-4e9a44961d4c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:12.367469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6bbd6dd5-5da7-4cb0-aba1-4e9a44961d4c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:12.374881 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6bbd6dd5-5da7-4cb0-aba1-4e9a44961d4c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:12.374994 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6bbd6dd5-5da7-4cb0-aba1-4e9a44961d4c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:12.375757 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6bbd6dd5-5da7-4cb0-aba1-4e9a44961d4c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:12.376309 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6bbd6dd5-5da7-4cb0-aba1-4e9a44961d4c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:12.593042 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6bbd6dd5-5da7-4cb0-aba1-4e9a44961d4c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:12.606372 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6bbd6dd5-5da7-4cb0-aba1-4e9a44961d4c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.244149 May 19 12:19:12.606978 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 105/176] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:12 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:13.105651 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-818a9d7b-bb71-4bd7-a833-0d464bb1b864 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:13.106275 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-818a9d7b-bb71-4bd7-a833-0d464bb1b864 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:13.112777 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-818a9d7b-bb71-4bd7-a833-0d464bb1b864 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:13.113234 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-818a9d7b-bb71-4bd7-a833-0d464bb1b864 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:13.114048 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-818a9d7b-bb71-4bd7-a833-0d464bb1b864 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:13.114483 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-818a9d7b-bb71-4bd7-a833-0d464bb1b864 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:13.279003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-818a9d7b-bb71-4bd7-a833-0d464bb1b864 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:13.289162 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-818a9d7b-bb71-4bd7-a833-0d464bb1b864 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.187943 May 19 12:19:13.290532 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 106/177] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:13 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:13.313808 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-69f46d43-50cb-4048-9f02-98e3a0341577 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:13.315988 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-69f46d43-50cb-4048-9f02-98e3a0341577 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:13.323563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-69f46d43-50cb-4048-9f02-98e3a0341577 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:13.324051 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-69f46d43-50cb-4048-9f02-98e3a0341577 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:13.325106 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-69f46d43-50cb-4048-9f02-98e3a0341577 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:13.325698 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-69f46d43-50cb-4048-9f02-98e3a0341577 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:13.472370 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-69f46d43-50cb-4048-9f02-98e3a0341577 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:13.497064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-69f46d43-50cb-4048-9f02-98e3a0341577 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.182253 May 19 12:19:13.497064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 107/178] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:13 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:13.623990 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9dc64688-383b-44d8-a33d-cb1aa2673ae2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:13.624607 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9dc64688-383b-44d8-a33d-cb1aa2673ae2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:13.631072 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9dc64688-383b-44d8-a33d-cb1aa2673ae2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:13.631503 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9dc64688-383b-44d8-a33d-cb1aa2673ae2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:13.632917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9dc64688-383b-44d8-a33d-cb1aa2673ae2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:13.633525 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9dc64688-383b-44d8-a33d-cb1aa2673ae2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:13.791995 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9dc64688-383b-44d8-a33d-cb1aa2673ae2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:13.799867 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9dc64688-383b-44d8-a33d-cb1aa2673ae2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.179797 May 19 12:19:13.800537 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 108/179] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:13 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:14.307547 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bc28c3f7-2e73-4794-b33d-2ff326e2c4af tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:14.308381 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bc28c3f7-2e73-4794-b33d-2ff326e2c4af tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:14.314765 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bc28c3f7-2e73-4794-b33d-2ff326e2c4af tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:14.315068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bc28c3f7-2e73-4794-b33d-2ff326e2c4af tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:14.315817 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bc28c3f7-2e73-4794-b33d-2ff326e2c4af tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:14.316258 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bc28c3f7-2e73-4794-b33d-2ff326e2c4af tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:14.465321 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bc28c3f7-2e73-4794-b33d-2ff326e2c4af tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:14.478234 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bc28c3f7-2e73-4794-b33d-2ff326e2c4af tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.174861 May 19 12:19:14.478821 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 109/180] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:14 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:14.504435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-40201dd3-e9a7-427b-b769-e92689625472 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:14.505050 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-40201dd3-e9a7-427b-b769-e92689625472 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:14.511879 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-40201dd3-e9a7-427b-b769-e92689625472 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:14.512732 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-40201dd3-e9a7-427b-b769-e92689625472 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:14.513493 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-40201dd3-e9a7-427b-b769-e92689625472 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:14.514078 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-40201dd3-e9a7-427b-b769-e92689625472 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:14.668249 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-40201dd3-e9a7-427b-b769-e92689625472 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:14.676642 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-40201dd3-e9a7-427b-b769-e92689625472 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.175999 May 19 12:19:14.677789 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 110/181] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:14 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:14.818943 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6271b80f-3e28-48c7-8a70-2a5e424352fc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:14.819711 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6271b80f-3e28-48c7-8a70-2a5e424352fc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:14.839116 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6271b80f-3e28-48c7-8a70-2a5e424352fc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:14.839611 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6271b80f-3e28-48c7-8a70-2a5e424352fc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:14.840527 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6271b80f-3e28-48c7-8a70-2a5e424352fc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:14.841092 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6271b80f-3e28-48c7-8a70-2a5e424352fc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:15.032860 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6271b80f-3e28-48c7-8a70-2a5e424352fc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:15.041690 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6271b80f-3e28-48c7-8a70-2a5e424352fc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.227135 May 19 12:19:15.042284 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 111/182] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:14 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:15.501053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2f0ab6b8-0af7-447f-bdd1-d56d451ddb35 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:15.501703 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2f0ab6b8-0af7-447f-bdd1-d56d451ddb35 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:15.509312 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f0ab6b8-0af7-447f-bdd1-d56d451ddb35 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:15.509760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f0ab6b8-0af7-447f-bdd1-d56d451ddb35 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:15.510657 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f0ab6b8-0af7-447f-bdd1-d56d451ddb35 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:15.511099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f0ab6b8-0af7-447f-bdd1-d56d451ddb35 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:15.656824 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2f0ab6b8-0af7-447f-bdd1-d56d451ddb35 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:15.665858 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2f0ab6b8-0af7-447f-bdd1-d56d451ddb35 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.168247 May 19 12:19:15.667164 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 112/183] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:15 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:15.694537 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-73342463-3212-4bba-b9bc-6d4b41534705 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:15.695187 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-73342463-3212-4bba-b9bc-6d4b41534705 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:15.701627 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-73342463-3212-4bba-b9bc-6d4b41534705 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:15.702746 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-73342463-3212-4bba-b9bc-6d4b41534705 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:15.703643 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-73342463-3212-4bba-b9bc-6d4b41534705 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:15.704339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-73342463-3212-4bba-b9bc-6d4b41534705 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:15.841916 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-73342463-3212-4bba-b9bc-6d4b41534705 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:15.849542 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-73342463-3212-4bba-b9bc-6d4b41534705 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.158761 May 19 12:19:15.850189 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 113/184] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:15 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:16.062037 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-307d9103-7010-4f8d-ac67-39338bd069cf tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:16.063014 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-307d9103-7010-4f8d-ac67-39338bd069cf tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:16.072777 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-307d9103-7010-4f8d-ac67-39338bd069cf tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:16.073724 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-307d9103-7010-4f8d-ac67-39338bd069cf tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:16.074778 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-307d9103-7010-4f8d-ac67-39338bd069cf tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:16.075241 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-307d9103-7010-4f8d-ac67-39338bd069cf tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:16.242645 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-307d9103-7010-4f8d-ac67-39338bd069cf tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:16.243567 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-307d9103-7010-4f8d-ac67-39338bd069cf tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.188507 May 19 12:19:16.244217 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 114/185] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:16 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:16.686458 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5297450f-dd3e-43cd-af2b-b9aba71b45ce tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:16.688235 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5297450f-dd3e-43cd-af2b-b9aba71b45ce tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:16.698404 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5297450f-dd3e-43cd-af2b-b9aba71b45ce tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:16.699015 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5297450f-dd3e-43cd-af2b-b9aba71b45ce tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:16.706460 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5297450f-dd3e-43cd-af2b-b9aba71b45ce tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:16.707008 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5297450f-dd3e-43cd-af2b-b9aba71b45ce tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:16.852179 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5297450f-dd3e-43cd-af2b-b9aba71b45ce tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:16.860296 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5297450f-dd3e-43cd-af2b-b9aba71b45ce tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.180622 May 19 12:19:16.861177 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 115/186] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:16 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:16.868518 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a2fe1e69-88c7-4d08-89ba-5235f62a726a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:16.869216 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a2fe1e69-88c7-4d08-89ba-5235f62a726a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:16.875093 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a2fe1e69-88c7-4d08-89ba-5235f62a726a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:16.875537 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a2fe1e69-88c7-4d08-89ba-5235f62a726a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:16.876325 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a2fe1e69-88c7-4d08-89ba-5235f62a726a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:16.876755 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a2fe1e69-88c7-4d08-89ba-5235f62a726a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:16.879309 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:17.027565 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a2fe1e69-88c7-4d08-89ba-5235f62a726a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:17.035275 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a2fe1e69-88c7-4d08-89ba-5235f62a726a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.172031 May 19 12:19:17.035873 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 116/187] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:16 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:17.261204 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-261ccfae-0c20-4316-8610-3ce3d54f4215 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:17.261817 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-261ccfae-0c20-4316-8610-3ce3d54f4215 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:17.268274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-261ccfae-0c20-4316-8610-3ce3d54f4215 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:17.269271 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-261ccfae-0c20-4316-8610-3ce3d54f4215 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:17.269471 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-261ccfae-0c20-4316-8610-3ce3d54f4215 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:17.270095 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-261ccfae-0c20-4316-8610-3ce3d54f4215 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:17.430170 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-261ccfae-0c20-4316-8610-3ce3d54f4215 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:17.440966 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-261ccfae-0c20-4316-8610-3ce3d54f4215 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.183392 May 19 12:19:17.441701 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 117/188] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:17 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:17.878625 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d1788367-799a-4aa4-8e58-57a7ce5956f5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:17.879277 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d1788367-799a-4aa4-8e58-57a7ce5956f5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:17.886503 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d1788367-799a-4aa4-8e58-57a7ce5956f5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:17.886958 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d1788367-799a-4aa4-8e58-57a7ce5956f5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:17.887739 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d1788367-799a-4aa4-8e58-57a7ce5956f5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:17.888199 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d1788367-799a-4aa4-8e58-57a7ce5956f5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:18.029032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d1788367-799a-4aa4-8e58-57a7ce5956f5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:18.036759 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d1788367-799a-4aa4-8e58-57a7ce5956f5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.162145 May 19 12:19:18.037429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 118/189] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:17 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:18.053097 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-cd0719c9-bbcb-4c12-92ed-ba384c40a9ac tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:18.053708 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-cd0719c9-bbcb-4c12-92ed-ba384c40a9ac tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:18.058465 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:18.061506 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cd0719c9-bbcb-4c12-92ed-ba384c40a9ac tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:18.061955 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cd0719c9-bbcb-4c12-92ed-ba384c40a9ac tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:18.063074 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cd0719c9-bbcb-4c12-92ed-ba384c40a9ac tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:18.063514 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cd0719c9-bbcb-4c12-92ed-ba384c40a9ac tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:18.220374 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-cd0719c9-bbcb-4c12-92ed-ba384c40a9ac tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:18.231398 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-cd0719c9-bbcb-4c12-92ed-ba384c40a9ac tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.182087 May 19 12:19:18.232028 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 119/190] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:18 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:18.461002 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2fb5d28c-d1d9-4d2f-91db-48a327b38cff tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:18.461795 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2fb5d28c-d1d9-4d2f-91db-48a327b38cff tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:18.469525 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2fb5d28c-d1d9-4d2f-91db-48a327b38cff tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:18.469963 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2fb5d28c-d1d9-4d2f-91db-48a327b38cff tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:18.473657 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2fb5d28c-d1d9-4d2f-91db-48a327b38cff tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:18.473657 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2fb5d28c-d1d9-4d2f-91db-48a327b38cff tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:18.625342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2fb5d28c-d1d9-4d2f-91db-48a327b38cff tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:18.633929 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2fb5d28c-d1d9-4d2f-91db-48a327b38cff tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.179259 May 19 12:19:18.634785 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 120/191] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:18 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:19.055161 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2eeff193-0ab8-4ee8-bad6-1f3cfc6958dc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:19.056142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2eeff193-0ab8-4ee8-bad6-1f3cfc6958dc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:19.066551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2eeff193-0ab8-4ee8-bad6-1f3cfc6958dc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:19.067164 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2eeff193-0ab8-4ee8-bad6-1f3cfc6958dc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:19.068232 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2eeff193-0ab8-4ee8-bad6-1f3cfc6958dc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:19.068674 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2eeff193-0ab8-4ee8-bad6-1f3cfc6958dc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:19.232490 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2eeff193-0ab8-4ee8-bad6-1f3cfc6958dc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:19.247622 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2eeff193-0ab8-4ee8-bad6-1f3cfc6958dc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.196873 May 19 12:19:19.251155 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 121/192] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:19 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:19.260414 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-b2854205-1ecf-4dc7-a934-fcefa16dc29b req-24e9f9d4-a040-4dff-8651-2a144b276af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68e76015-a6d8-4580-a1ab-4a11f42cb6f0", "name": "network-vif-plugged", "status": "completed", "tag": "0269a249-9630-404e-8eb1-a23ce804a3bd"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:19:19.274219 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-b2854205-1ecf-4dc7-a934-fcefa16dc29b req-24e9f9d4-a040-4dff-8651-2a144b276af3 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:19.274874 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-b2854205-1ecf-4dc7-a934-fcefa16dc29b req-24e9f9d4-a040-4dff-8651-2a144b276af3 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:19.288725 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-b2854205-1ecf-4dc7-a934-fcefa16dc29b req-24e9f9d4-a040-4dff-8651-2a144b276af3 service nova] Creating event network-vif-plugged:0269a249-9630-404e-8eb1-a23ce804a3bd for instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 on hv-cinder-80475 May 19 12:19:19.294813 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-b2854205-1ecf-4dc7-a934-fcefa16dc29b req-24e9f9d4-a040-4dff-8651-2a144b276af3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042222 May 19 12:19:19.295431 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 122/193] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:19:19.302025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3223f7df-599c-4921-bbb9-5e870a4558e0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:19.302025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3223f7df-599c-4921-bbb9-5e870a4558e0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:19.309825 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3223f7df-599c-4921-bbb9-5e870a4558e0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:19.310281 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3223f7df-599c-4921-bbb9-5e870a4558e0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:19.311049 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3223f7df-599c-4921-bbb9-5e870a4558e0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:19.311496 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3223f7df-599c-4921-bbb9-5e870a4558e0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:19.448468 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3223f7df-599c-4921-bbb9-5e870a4558e0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:19.456110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3223f7df-599c-4921-bbb9-5e870a4558e0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.159492 May 19 12:19:19.456681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 123/194] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:19 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:19.651212 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a84bfb52-9f8e-4ef5-8a72-5f486b7669cc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:19.651967 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a84bfb52-9f8e-4ef5-8a72-5f486b7669cc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:19.658390 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a84bfb52-9f8e-4ef5-8a72-5f486b7669cc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:19.659197 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a84bfb52-9f8e-4ef5-8a72-5f486b7669cc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:19.659613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a84bfb52-9f8e-4ef5-8a72-5f486b7669cc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:19.660056 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a84bfb52-9f8e-4ef5-8a72-5f486b7669cc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:19.800313 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a84bfb52-9f8e-4ef5-8a72-5f486b7669cc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:19.808879 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a84bfb52-9f8e-4ef5-8a72-5f486b7669cc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.161880 May 19 12:19:19.809479 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 124/195] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:19 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:20.268290 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1f89250a-13b5-4ba7-83bb-0044a566564d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:20.268956 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1f89250a-13b5-4ba7-83bb-0044a566564d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:20.282907 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1f89250a-13b5-4ba7-83bb-0044a566564d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:20.282907 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1f89250a-13b5-4ba7-83bb-0044a566564d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:20.282907 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1f89250a-13b5-4ba7-83bb-0044a566564d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:20.282907 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1f89250a-13b5-4ba7-83bb-0044a566564d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:20.415352 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1f89250a-13b5-4ba7-83bb-0044a566564d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:20.423442 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1f89250a-13b5-4ba7-83bb-0044a566564d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.158963 May 19 12:19:20.424071 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 125/196] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:20 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:20.479756 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6adc0f7a-4e99-4275-92b6-c9e2f99305b7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:20.480896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6adc0f7a-4e99-4275-92b6-c9e2f99305b7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:20.491613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6adc0f7a-4e99-4275-92b6-c9e2f99305b7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:20.492740 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6adc0f7a-4e99-4275-92b6-c9e2f99305b7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:20.508377 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6adc0f7a-4e99-4275-92b6-c9e2f99305b7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:20.508956 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6adc0f7a-4e99-4275-92b6-c9e2f99305b7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:20.706427 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6adc0f7a-4e99-4275-92b6-c9e2f99305b7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:20.717906 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6adc0f7a-4e99-4275-92b6-c9e2f99305b7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.247551 May 19 12:19:20.718503 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 126/197] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:20 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:20.829275 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5ebeb38d-aa81-4bac-8a21-dbf1593fdfcc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:20.830091 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5ebeb38d-aa81-4bac-8a21-dbf1593fdfcc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:20.840211 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ebeb38d-aa81-4bac-8a21-dbf1593fdfcc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:20.840675 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ebeb38d-aa81-4bac-8a21-dbf1593fdfcc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:20.841947 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ebeb38d-aa81-4bac-8a21-dbf1593fdfcc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:20.842385 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ebeb38d-aa81-4bac-8a21-dbf1593fdfcc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:20.908631 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-169d48b7-6a96-4629-b840-f93f77691626 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "POST /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 19.324419 May 19 12:19:20.910210 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 72/198] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 19 12:19:01 2022] POST /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a/os-volume_attachments => generated 194 bytes in 19327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:19:21.002454 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5ebeb38d-aa81-4bac-8a21-dbf1593fdfcc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:21.010869 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5ebeb38d-aa81-4bac-8a21-dbf1593fdfcc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.186062 May 19 12:19:21.011467 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 127/199] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:20 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:21.442102 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-7e60fedd-8256-4530-a1fa-e3cd3cefd8a0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:21.442797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-7e60fedd-8256-4530-a1fa-e3cd3cefd8a0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:21.450343 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7e60fedd-8256-4530-a1fa-e3cd3cefd8a0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:21.450783 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7e60fedd-8256-4530-a1fa-e3cd3cefd8a0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:21.451541 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7e60fedd-8256-4530-a1fa-e3cd3cefd8a0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:21.452000 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7e60fedd-8256-4530-a1fa-e3cd3cefd8a0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:21.597738 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-7e60fedd-8256-4530-a1fa-e3cd3cefd8a0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:21.605674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-7e60fedd-8256-4530-a1fa-e3cd3cefd8a0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.167760 May 19 12:19:21.606238 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 73/200] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:21 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:21.736757 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5cfc1d17-fed9-4b3e-91c0-19af3dfd0180 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:21.737409 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5cfc1d17-fed9-4b3e-91c0-19af3dfd0180 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:21.745494 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5cfc1d17-fed9-4b3e-91c0-19af3dfd0180 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:21.745944 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5cfc1d17-fed9-4b3e-91c0-19af3dfd0180 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:21.746758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5cfc1d17-fed9-4b3e-91c0-19af3dfd0180 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:21.747195 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5cfc1d17-fed9-4b3e-91c0-19af3dfd0180 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:21.916128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5cfc1d17-fed9-4b3e-91c0-19af3dfd0180 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:21.924112 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5cfc1d17-fed9-4b3e-91c0-19af3dfd0180 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.191254 May 19 12:19:21.924702 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 128/201] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:21 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:22.029963 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ee64f90a-ab58-4b91-8ab1-9bc3e5d2fd5b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:22.031061 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ee64f90a-ab58-4b91-8ab1-9bc3e5d2fd5b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:22.037496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ee64f90a-ab58-4b91-8ab1-9bc3e5d2fd5b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:22.038434 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ee64f90a-ab58-4b91-8ab1-9bc3e5d2fd5b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:22.040412 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ee64f90a-ab58-4b91-8ab1-9bc3e5d2fd5b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:22.040977 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ee64f90a-ab58-4b91-8ab1-9bc3e5d2fd5b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:22.174334 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ee64f90a-ab58-4b91-8ab1-9bc3e5d2fd5b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:22.182246 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ee64f90a-ab58-4b91-8ab1-9bc3e5d2fd5b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.157233 May 19 12:19:22.182837 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 74/202] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:22 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:22.622892 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bce8435b-787d-48df-a66d-f43f9f2cc3dd tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:22.623503 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bce8435b-787d-48df-a66d-f43f9f2cc3dd tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:22.629797 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bce8435b-787d-48df-a66d-f43f9f2cc3dd tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:22.630251 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bce8435b-787d-48df-a66d-f43f9f2cc3dd tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:22.631171 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bce8435b-787d-48df-a66d-f43f9f2cc3dd tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:22.631615 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bce8435b-787d-48df-a66d-f43f9f2cc3dd tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:22.776265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bce8435b-787d-48df-a66d-f43f9f2cc3dd tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:22.786022 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bce8435b-787d-48df-a66d-f43f9f2cc3dd tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.166875 May 19 12:19:22.786965 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 129/203] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:22 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:22.943062 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-3e8c1899-ac09-41f0-83a1-a14122df2a74 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:22.943909 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-3e8c1899-ac09-41f0-83a1-a14122df2a74 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:22.953196 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3e8c1899-ac09-41f0-83a1-a14122df2a74 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:22.954155 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3e8c1899-ac09-41f0-83a1-a14122df2a74 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:22.955299 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3e8c1899-ac09-41f0-83a1-a14122df2a74 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:22.955942 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3e8c1899-ac09-41f0-83a1-a14122df2a74 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:23.113990 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-3e8c1899-ac09-41f0-83a1-a14122df2a74 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:23.122265 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-3e8c1899-ac09-41f0-83a1-a14122df2a74 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.183109 May 19 12:19:23.122916 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 75/204] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:22 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:23.205118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e507dd4f-72cb-4b37-9662-b79b784e5e41 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:23.205118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e507dd4f-72cb-4b37-9662-b79b784e5e41 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:23.211235 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e507dd4f-72cb-4b37-9662-b79b784e5e41 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:23.219653 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e507dd4f-72cb-4b37-9662-b79b784e5e41 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:23.220748 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e507dd4f-72cb-4b37-9662-b79b784e5e41 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:23.221202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e507dd4f-72cb-4b37-9662-b79b784e5e41 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:23.363973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e507dd4f-72cb-4b37-9662-b79b784e5e41 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:23.373534 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e507dd4f-72cb-4b37-9662-b79b784e5e41 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.178198 May 19 12:19:23.374121 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 130/205] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:23 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:23.803953 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5968e63b-88bc-4022-b483-e792b82dd480 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:23.804620 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5968e63b-88bc-4022-b483-e792b82dd480 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:23.811087 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5968e63b-88bc-4022-b483-e792b82dd480 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:23.811590 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5968e63b-88bc-4022-b483-e792b82dd480 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:23.812583 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5968e63b-88bc-4022-b483-e792b82dd480 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:23.813034 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5968e63b-88bc-4022-b483-e792b82dd480 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:23.960112 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5968e63b-88bc-4022-b483-e792b82dd480 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:24.006600 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5968e63b-88bc-4022-b483-e792b82dd480 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.170126 May 19 12:19:24.006600 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 76/206] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:23 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:24.139643 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-aae99f9f-643f-42a6-903c-80bd9c128569 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:24.140284 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-aae99f9f-643f-42a6-903c-80bd9c128569 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:24.146867 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-aae99f9f-643f-42a6-903c-80bd9c128569 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:24.147298 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-aae99f9f-643f-42a6-903c-80bd9c128569 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:24.148937 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-aae99f9f-643f-42a6-903c-80bd9c128569 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:24.149629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-aae99f9f-643f-42a6-903c-80bd9c128569 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:24.303712 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-aae99f9f-643f-42a6-903c-80bd9c128569 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:24.312222 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-aae99f9f-643f-42a6-903c-80bd9c128569 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.176350 May 19 12:19:24.312797 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 131/207] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:24 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:24.394448 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b76e2ff3-9627-45eb-b530-8335c8ec588e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:24.394448 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-b76e2ff3-9627-45eb-b530-8335c8ec588e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:24.398105 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b76e2ff3-9627-45eb-b530-8335c8ec588e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:24.398641 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b76e2ff3-9627-45eb-b530-8335c8ec588e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:24.399464 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b76e2ff3-9627-45eb-b530-8335c8ec588e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:24.399982 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b76e2ff3-9627-45eb-b530-8335c8ec588e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:24.536057 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b76e2ff3-9627-45eb-b530-8335c8ec588e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:24.545072 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b76e2ff3-9627-45eb-b530-8335c8ec588e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.158397 May 19 12:19:24.545652 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 77/208] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:24 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:25.022493 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f772c502-4b58-44d8-a1f3-9824629a570f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:25.023515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f772c502-4b58-44d8-a1f3-9824629a570f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:25.030341 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f772c502-4b58-44d8-a1f3-9824629a570f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:25.031089 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f772c502-4b58-44d8-a1f3-9824629a570f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:25.031969 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f772c502-4b58-44d8-a1f3-9824629a570f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:25.032449 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f772c502-4b58-44d8-a1f3-9824629a570f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:25.171630 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f772c502-4b58-44d8-a1f3-9824629a570f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:25.185546 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f772c502-4b58-44d8-a1f3-9824629a570f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.166835 May 19 12:19:25.188369 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 132/209] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:25 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:25.333577 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f2ae6521-12f2-47e6-8edd-b0be908b77ea tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:25.334298 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f2ae6521-12f2-47e6-8edd-b0be908b77ea tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:25.341726 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f2ae6521-12f2-47e6-8edd-b0be908b77ea tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:25.342349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f2ae6521-12f2-47e6-8edd-b0be908b77ea tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:25.343810 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f2ae6521-12f2-47e6-8edd-b0be908b77ea tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:25.344666 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f2ae6521-12f2-47e6-8edd-b0be908b77ea tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:25.484556 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f2ae6521-12f2-47e6-8edd-b0be908b77ea tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:25.493613 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f2ae6521-12f2-47e6-8edd-b0be908b77ea tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.163769 May 19 12:19:25.494201 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 78/210] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:25 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:25.561997 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5893da60-f2e7-4109-b194-139d72ab9a5f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:25.562750 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5893da60-f2e7-4109-b194-139d72ab9a5f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:25.569014 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5893da60-f2e7-4109-b194-139d72ab9a5f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:25.569475 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5893da60-f2e7-4109-b194-139d72ab9a5f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:25.570250 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5893da60-f2e7-4109-b194-139d72ab9a5f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:25.570692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5893da60-f2e7-4109-b194-139d72ab9a5f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:25.586780 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:25.703924 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5893da60-f2e7-4109-b194-139d72ab9a5f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:25.711518 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5893da60-f2e7-4109-b194-139d72ab9a5f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.153533 May 19 12:19:25.712277 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 133/211] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:25 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:26.204380 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-eadb962b-bdaf-43d7-8d12-9b47e2923c43 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:26.223639 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-eadb962b-bdaf-43d7-8d12-9b47e2923c43 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:26.223639 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-eadb962b-bdaf-43d7-8d12-9b47e2923c43 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:26.223639 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-eadb962b-bdaf-43d7-8d12-9b47e2923c43 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:26.223639 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-eadb962b-bdaf-43d7-8d12-9b47e2923c43 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:26.224262 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-eadb962b-bdaf-43d7-8d12-9b47e2923c43 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:26.361564 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-eadb962b-bdaf-43d7-8d12-9b47e2923c43 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:26.370748 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-eadb962b-bdaf-43d7-8d12-9b47e2923c43 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.170575 May 19 12:19:26.371331 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 79/212] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:26 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:26.511912 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-24a766f3-517c-452d-a3d2-dab6e7605953 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:26.512467 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-24a766f3-517c-452d-a3d2-dab6e7605953 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:26.518948 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24a766f3-517c-452d-a3d2-dab6e7605953 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:26.519393 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24a766f3-517c-452d-a3d2-dab6e7605953 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:26.520195 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24a766f3-517c-452d-a3d2-dab6e7605953 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:26.520629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24a766f3-517c-452d-a3d2-dab6e7605953 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:26.655178 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-24a766f3-517c-452d-a3d2-dab6e7605953 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:26.662834 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-24a766f3-517c-452d-a3d2-dab6e7605953 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.155894 May 19 12:19:26.663416 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 134/213] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:26 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:26.729980 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a074ce03-126a-425f-8c5d-8d23710c3792 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:26.730597 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a074ce03-126a-425f-8c5d-8d23710c3792 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:26.736793 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a074ce03-126a-425f-8c5d-8d23710c3792 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:26.737231 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a074ce03-126a-425f-8c5d-8d23710c3792 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:26.738019 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a074ce03-126a-425f-8c5d-8d23710c3792 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:26.738454 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a074ce03-126a-425f-8c5d-8d23710c3792 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:26.873573 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a074ce03-126a-425f-8c5d-8d23710c3792 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:26.888683 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a074ce03-126a-425f-8c5d-8d23710c3792 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1363 microversion: 2.1 time: 0.162349 May 19 12:19:26.904963 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 80/214] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:26 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:27.388569 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-92e44cf8-8376-449d-ac8c-97f524c258a7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:27.389100 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-92e44cf8-8376-449d-ac8c-97f524c258a7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:27.396098 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-92e44cf8-8376-449d-ac8c-97f524c258a7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:27.396555 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-92e44cf8-8376-449d-ac8c-97f524c258a7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:27.397388 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-92e44cf8-8376-449d-ac8c-97f524c258a7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:27.398431 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-92e44cf8-8376-449d-ac8c-97f524c258a7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:27.548585 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-92e44cf8-8376-449d-ac8c-97f524c258a7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:27.557429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-92e44cf8-8376-449d-ac8c-97f524c258a7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.173115 May 19 12:19:27.558019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 135/215] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:27 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:27.683048 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0e99b9a4-4977-48bf-983b-7c6ceeefba22 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:27.683048 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0e99b9a4-4977-48bf-983b-7c6ceeefba22 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:27.691537 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0e99b9a4-4977-48bf-983b-7c6ceeefba22 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:27.693378 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0e99b9a4-4977-48bf-983b-7c6ceeefba22 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:27.693378 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0e99b9a4-4977-48bf-983b-7c6ceeefba22 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:27.693566 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0e99b9a4-4977-48bf-983b-7c6ceeefba22 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:27.847701 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-0e99b9a4-4977-48bf-983b-7c6ceeefba22 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:27.860497 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0e99b9a4-4977-48bf-983b-7c6ceeefba22 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.183977 May 19 12:19:27.861689 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 81/216] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:27 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:27.915707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7def38d3-8c78-4259-a99e-e0342186fdc2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:27.916282 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7def38d3-8c78-4259-a99e-e0342186fdc2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:27.922895 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7def38d3-8c78-4259-a99e-e0342186fdc2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:27.923350 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7def38d3-8c78-4259-a99e-e0342186fdc2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:27.924210 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7def38d3-8c78-4259-a99e-e0342186fdc2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:27.924640 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7def38d3-8c78-4259-a99e-e0342186fdc2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:28.061459 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-8f8466ec-2702-4f17-99f5-990cc082ce81 req-023184cf-4acb-4da7-ba22-be6d301a4fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51363d7f-7d31-427b-87c1-fa437e713d85", "name": "network-vif-plugged", "status": "completed", "tag": "a5bc79ff-3cb4-40ee-b6c7-d0520edd0a76"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:19:28.071432 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-8f8466ec-2702-4f17-99f5-990cc082ce81 req-023184cf-4acb-4da7-ba22-be6d301a4fce service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:28.072136 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-8f8466ec-2702-4f17-99f5-990cc082ce81 req-023184cf-4acb-4da7-ba22-be6d301a4fce service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:28.079368 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7def38d3-8c78-4259-a99e-e0342186fdc2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:28.087685 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7def38d3-8c78-4259-a99e-e0342186fdc2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1549 microversion: 2.1 time: 0.176785 May 19 12:19:28.088322 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 136/217] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:27 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1549 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:28.094569 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-8f8466ec-2702-4f17-99f5-990cc082ce81 req-023184cf-4acb-4da7-ba22-be6d301a4fce service nova] Creating event network-vif-plugged:a5bc79ff-3cb4-40ee-b6c7-d0520edd0a76 for instance 51363d7f-7d31-427b-87c1-fa437e713d85 on hv-cinder-80475 May 19 12:19:28.094569 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-8f8466ec-2702-4f17-99f5-990cc082ce81 req-023184cf-4acb-4da7-ba22-be6d301a4fce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036036 May 19 12:19:28.094569 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 82/218] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:19:28.106637 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5c35bbab-3be9-4b8a-bfe1-ceacae8f9079 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:28.107131 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5c35bbab-3be9-4b8a-bfe1-ceacae8f9079 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:28.114096 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c35bbab-3be9-4b8a-bfe1-ceacae8f9079 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:28.114659 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c35bbab-3be9-4b8a-bfe1-ceacae8f9079 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:28.115432 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c35bbab-3be9-4b8a-bfe1-ceacae8f9079 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:28.115892 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c35bbab-3be9-4b8a-bfe1-ceacae8f9079 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:28.213971 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5c35bbab-3be9-4b8a-bfe1-ceacae8f9079 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096984 May 19 12:19:28.213971 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 137/219] 10.222.0.23 () {58 vars in 1274 bytes} [Thu May 19 12:19:28 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:19:28.574297 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e2d1d2fd-194b-4e3f-a2c5-940d516384fe tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:28.574980 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e2d1d2fd-194b-4e3f-a2c5-940d516384fe tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:28.590243 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e2d1d2fd-194b-4e3f-a2c5-940d516384fe tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:28.591347 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e2d1d2fd-194b-4e3f-a2c5-940d516384fe tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:28.592188 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e2d1d2fd-194b-4e3f-a2c5-940d516384fe tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:28.592791 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e2d1d2fd-194b-4e3f-a2c5-940d516384fe tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:28.878286 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-29e9f640-06d9-482e-af91-d6de1e977c93 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:28.879739 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-29e9f640-06d9-482e-af91-d6de1e977c93 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:28.887149 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-29e9f640-06d9-482e-af91-d6de1e977c93 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:28.888260 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-29e9f640-06d9-482e-af91-d6de1e977c93 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:28.889135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-29e9f640-06d9-482e-af91-d6de1e977c93 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:28.890882 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-29e9f640-06d9-482e-af91-d6de1e977c93 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:29.106391 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e2d1d2fd-194b-4e3f-a2c5-940d516384fe tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:29.114457 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e2d1d2fd-194b-4e3f-a2c5-940d516384fe tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.544394 May 19 12:19:29.119601 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 83/220] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:28 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:29.228615 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-29e9f640-06d9-482e-af91-d6de1e977c93 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:29.237543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-29e9f640-06d9-482e-af91-d6de1e977c93 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.363052 May 19 12:19:29.244860 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 138/221] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:28 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:29.943141 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-aa963462-ff7d-4671-9a6d-2e15475465cc req-aa356c79-b04e-4c2a-bd48-66e927856096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68e76015-a6d8-4580-a1ab-4a11f42cb6f0", "tag": "0269a249-9630-404e-8eb1-a23ce804a3bd"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:19:29.954137 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-aa963462-ff7d-4671-9a6d-2e15475465cc req-aa356c79-b04e-4c2a-bd48-66e927856096 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:29.954723 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-aa963462-ff7d-4671-9a6d-2e15475465cc req-aa356c79-b04e-4c2a-bd48-66e927856096 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:29.968026 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-aa963462-ff7d-4671-9a6d-2e15475465cc req-aa356c79-b04e-4c2a-bd48-66e927856096 service nova] Creating event network-changed:0269a249-9630-404e-8eb1-a23ce804a3bd for instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 on hv-cinder-80475 May 19 12:19:29.973522 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-aa963462-ff7d-4671-9a6d-2e15475465cc req-aa356c79-b04e-4c2a-bd48-66e927856096 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034771 May 19 12:19:29.974124 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 84/222] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:19:30.133363 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ea5508c5-bfa7-476c-8304-22bc95f52460 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:30.141000 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ea5508c5-bfa7-476c-8304-22bc95f52460 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:30.141465 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ea5508c5-bfa7-476c-8304-22bc95f52460 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:30.141926 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ea5508c5-bfa7-476c-8304-22bc95f52460 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:30.142847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ea5508c5-bfa7-476c-8304-22bc95f52460 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:30.143297 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ea5508c5-bfa7-476c-8304-22bc95f52460 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:30.262322 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-917fe960-118f-4561-90b0-2c868bffcbe6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:30.263139 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-917fe960-118f-4561-90b0-2c868bffcbe6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:30.280200 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-917fe960-118f-4561-90b0-2c868bffcbe6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:30.280200 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-917fe960-118f-4561-90b0-2c868bffcbe6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:30.281180 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-917fe960-118f-4561-90b0-2c868bffcbe6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:30.283589 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-917fe960-118f-4561-90b0-2c868bffcbe6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:30.328852 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ea5508c5-bfa7-476c-8304-22bc95f52460 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:30.347287 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ea5508c5-bfa7-476c-8304-22bc95f52460 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.217969 May 19 12:19:30.360430 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 139/223] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:30 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:30.521433 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-917fe960-118f-4561-90b0-2c868bffcbe6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:30.534708 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-917fe960-118f-4561-90b0-2c868bffcbe6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.278070 May 19 12:19:30.547528 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 85/224] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:30 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:31.377559 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f617c922-9fa8-4b10-9e6b-4e43353c5a51 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:31.379701 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f617c922-9fa8-4b10-9e6b-4e43353c5a51 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:31.390582 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f617c922-9fa8-4b10-9e6b-4e43353c5a51 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:31.391187 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f617c922-9fa8-4b10-9e6b-4e43353c5a51 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:31.392124 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f617c922-9fa8-4b10-9e6b-4e43353c5a51 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:31.392740 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f617c922-9fa8-4b10-9e6b-4e43353c5a51 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:31.554848 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f617c922-9fa8-4b10-9e6b-4e43353c5a51 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:31.561024 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-85a443d7-3681-44c8-b61d-4565bef91817 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:31.561750 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-85a443d7-3681-44c8-b61d-4565bef91817 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:31.569563 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-85a443d7-3681-44c8-b61d-4565bef91817 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:31.570176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-85a443d7-3681-44c8-b61d-4565bef91817 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:31.570813 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-85a443d7-3681-44c8-b61d-4565bef91817 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:31.571439 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-85a443d7-3681-44c8-b61d-4565bef91817 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:31.574307 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f617c922-9fa8-4b10-9e6b-4e43353c5a51 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.204006 May 19 12:19:31.575848 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 140/225] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:31 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:31.737293 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-85a443d7-3681-44c8-b61d-4565bef91817 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:31.745658 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-85a443d7-3681-44c8-b61d-4565bef91817 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.196366 May 19 12:19:31.746229 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 86/226] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:31 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:32.592710 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-cf7103c9-3229-40a5-8c6d-7bfe7eace73b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:32.593312 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-cf7103c9-3229-40a5-8c6d-7bfe7eace73b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:32.599535 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cf7103c9-3229-40a5-8c6d-7bfe7eace73b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:32.600049 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cf7103c9-3229-40a5-8c6d-7bfe7eace73b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:32.600808 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cf7103c9-3229-40a5-8c6d-7bfe7eace73b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:32.601892 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cf7103c9-3229-40a5-8c6d-7bfe7eace73b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:32.758153 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-cf7103c9-3229-40a5-8c6d-7bfe7eace73b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:32.762697 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-da1c28cc-e309-422c-a507-d43fb3b07330 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:32.763307 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-da1c28cc-e309-422c-a507-d43fb3b07330 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:32.766436 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-cf7103c9-3229-40a5-8c6d-7bfe7eace73b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.177610 May 19 12:19:32.767009 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 141/227] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:32 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:32.772003 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-da1c28cc-e309-422c-a507-d43fb3b07330 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:32.772452 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-da1c28cc-e309-422c-a507-d43fb3b07330 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:32.773759 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-da1c28cc-e309-422c-a507-d43fb3b07330 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:32.774195 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-da1c28cc-e309-422c-a507-d43fb3b07330 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:32.915688 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-da1c28cc-e309-422c-a507-d43fb3b07330 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:32.924155 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-da1c28cc-e309-422c-a507-d43fb3b07330 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.165081 May 19 12:19:32.924660 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 87/228] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:32 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:33.784481 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6f864af1-6832-4bc4-b574-2a59b0f58783 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:33.785730 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6f864af1-6832-4bc4-b574-2a59b0f58783 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:33.794723 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6f864af1-6832-4bc4-b574-2a59b0f58783 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:33.795545 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6f864af1-6832-4bc4-b574-2a59b0f58783 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:33.796603 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6f864af1-6832-4bc4-b574-2a59b0f58783 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:33.797351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6f864af1-6832-4bc4-b574-2a59b0f58783 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:33.941875 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-8aee26bc-a3a4-4436-9eb4-cf506234ec53 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:33.943170 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-8aee26bc-a3a4-4436-9eb4-cf506234ec53 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:33.956558 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8aee26bc-a3a4-4436-9eb4-cf506234ec53 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:33.957429 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8aee26bc-a3a4-4436-9eb4-cf506234ec53 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:33.958561 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8aee26bc-a3a4-4436-9eb4-cf506234ec53 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:33.959723 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8aee26bc-a3a4-4436-9eb4-cf506234ec53 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:34.255181 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6f864af1-6832-4bc4-b574-2a59b0f58783 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:34.269157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6f864af1-6832-4bc4-b574-2a59b0f58783 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.488848 May 19 12:19:34.269851 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 142/229] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:33 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:34.363970 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-8aee26bc-a3a4-4436-9eb4-cf506234ec53 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:34.372270 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-8aee26bc-a3a4-4436-9eb4-cf506234ec53 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.434561 May 19 12:19:34.372857 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 88/230] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:33 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:35.288233 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-14a98ae2-a569-44ad-896e-91307f5f9b9d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:35.289224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-14a98ae2-a569-44ad-896e-91307f5f9b9d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:35.295180 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-14a98ae2-a569-44ad-896e-91307f5f9b9d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:35.295626 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-14a98ae2-a569-44ad-896e-91307f5f9b9d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:35.296427 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-14a98ae2-a569-44ad-896e-91307f5f9b9d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:35.296864 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-14a98ae2-a569-44ad-896e-91307f5f9b9d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:35.389880 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-37bbb94a-7268-4774-abad-4a5f59b3e9b6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:35.390554 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-37bbb94a-7268-4774-abad-4a5f59b3e9b6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:35.396820 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-37bbb94a-7268-4774-abad-4a5f59b3e9b6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:35.411012 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-37bbb94a-7268-4774-abad-4a5f59b3e9b6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:35.411908 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-37bbb94a-7268-4774-abad-4a5f59b3e9b6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:35.412345 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-37bbb94a-7268-4774-abad-4a5f59b3e9b6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:35.437959 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:35.461404 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-14a98ae2-a569-44ad-896e-91307f5f9b9d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:35.471284 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-14a98ae2-a569-44ad-896e-91307f5f9b9d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.187078 May 19 12:19:35.476581 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 143/231] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:35 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:35.572812 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-37bbb94a-7268-4774-abad-4a5f59b3e9b6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:35.580643 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-37bbb94a-7268-4774-abad-4a5f59b3e9b6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.194816 May 19 12:19:35.581206 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 89/232] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:35 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:36.488708 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-094e1208-08c0-4070-97e9-cff5a81251c0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:36.489398 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-094e1208-08c0-4070-97e9-cff5a81251c0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:36.496546 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-094e1208-08c0-4070-97e9-cff5a81251c0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:36.497075 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-094e1208-08c0-4070-97e9-cff5a81251c0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:36.497936 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-094e1208-08c0-4070-97e9-cff5a81251c0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:36.498436 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-094e1208-08c0-4070-97e9-cff5a81251c0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:36.598422 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9fc65a1b-e2fc-4463-93c3-9a1dfa98a728 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:36.599180 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9fc65a1b-e2fc-4463-93c3-9a1dfa98a728 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:36.607580 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9fc65a1b-e2fc-4463-93c3-9a1dfa98a728 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:36.608088 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9fc65a1b-e2fc-4463-93c3-9a1dfa98a728 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:36.608959 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9fc65a1b-e2fc-4463-93c3-9a1dfa98a728 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:36.609397 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9fc65a1b-e2fc-4463-93c3-9a1dfa98a728 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:36.681282 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-094e1208-08c0-4070-97e9-cff5a81251c0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:36.689815 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-094e1208-08c0-4070-97e9-cff5a81251c0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.204727 May 19 12:19:36.694502 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 144/233] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:36 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:36.946495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9fc65a1b-e2fc-4463-93c3-9a1dfa98a728 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:36.968288 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9fc65a1b-e2fc-4463-93c3-9a1dfa98a728 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1367 microversion: 2.1 time: 0.362885 May 19 12:19:36.968288 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 90/234] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:36 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1367 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:37.708094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2a332767-007b-4d8b-8a53-678468e5a6a8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:37.708730 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2a332767-007b-4d8b-8a53-678468e5a6a8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:37.714977 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2a332767-007b-4d8b-8a53-678468e5a6a8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:37.715461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2a332767-007b-4d8b-8a53-678468e5a6a8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:37.716269 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2a332767-007b-4d8b-8a53-678468e5a6a8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:37.716728 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2a332767-007b-4d8b-8a53-678468e5a6a8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:37.858666 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2a332767-007b-4d8b-8a53-678468e5a6a8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:37.866456 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2a332767-007b-4d8b-8a53-678468e5a6a8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.162507 May 19 12:19:37.867815 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 145/235] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:37 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:37.982535 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d6f6e916-c28b-4474-ba6f-e3abe3c75609 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:37.982535 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d6f6e916-c28b-4474-ba6f-e3abe3c75609 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:37.984260 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d6f6e916-c28b-4474-ba6f-e3abe3c75609 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:37.984719 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d6f6e916-c28b-4474-ba6f-e3abe3c75609 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:37.985493 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d6f6e916-c28b-4474-ba6f-e3abe3c75609 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:37.985959 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d6f6e916-c28b-4474-ba6f-e3abe3c75609 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:38.142858 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d6f6e916-c28b-4474-ba6f-e3abe3c75609 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:38.151595 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d6f6e916-c28b-4474-ba6f-e3abe3c75609 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1556 microversion: 2.1 time: 0.179017 May 19 12:19:38.165487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 91/236] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:37 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1556 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:38.165748 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0e657506-1e96-4a16-a025-427757f0db48 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1866274035", "imageRef": "962252c6-9c2c-4b81-bdb7-f6d317bada3b", "flavorRef": "452", "networks": [{"uuid": "8bb85304-d5d6-43de-9b5a-76646e161de6"}]}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:19:38.171175 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-7aa0da0e-1289-4547-a59a-5c37b14ab0a8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:38.171762 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-7aa0da0e-1289-4547-a59a-5c37b14ab0a8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:38.178724 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7aa0da0e-1289-4547-a59a-5c37b14ab0a8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:38.179332 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7aa0da0e-1289-4547-a59a-5c37b14ab0a8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:38.181359 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7aa0da0e-1289-4547-a59a-5c37b14ab0a8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:38.181872 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7aa0da0e-1289-4547-a59a-5c37b14ab0a8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:38.219086 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-0e657506-1e96-4a16-a025-427757f0db48 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] validate_networks() for [('8bb85304-d5d6-43de-9b5a-76646e161de6', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:19:38.349854 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-7aa0da0e-1289-4547-a59a-5c37b14ab0a8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.182596 May 19 12:19:38.357189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 92/237] 10.222.0.23 () {58 vars in 1274 bytes} [Thu May 19 12:19:38 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:19:38.839469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-0e657506-1e96-4a16-a025-427757f0db48 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:19:38.840572 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-0e657506-1e96-4a16-a025-427757f0db48 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:19:38.841122 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-0e657506-1e96-4a16-a025-427757f0db48 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:19:38.841541 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-0e657506-1e96-4a16-a025-427757f0db48 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:19:38.842324 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-0e657506-1e96-4a16-a025-427757f0db48 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:19:38.856480 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e657506-1e96-4a16-a025-427757f0db48 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:38.856925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e657506-1e96-4a16-a025-427757f0db48 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:38.857780 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e657506-1e96-4a16-a025-427757f0db48 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:38.859772 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e657506-1e96-4a16-a025-427757f0db48 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:38.879957 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-0e657506-1e96-4a16-a025-427757f0db48 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Getting quotas for project 79e70c946e5440e39ee1d7cbeb0a4160. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:19:38.885625 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-2eef2657-643a-4241-a58c-5e768cc9a765 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:38.886239 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-2eef2657-643a-4241-a58c-5e768cc9a765 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:38.886360 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-0e657506-1e96-4a16-a025-427757f0db48 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Getting quotas for user 858ef1572f064c248592e92625b228f8 and project 79e70c946e5440e39ee1d7cbeb0a4160. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:19:38.893184 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2eef2657-643a-4241-a58c-5e768cc9a765 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:38.893720 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2eef2657-643a-4241-a58c-5e768cc9a765 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:38.897058 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2eef2657-643a-4241-a58c-5e768cc9a765 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:38.897058 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2eef2657-643a-4241-a58c-5e768cc9a765 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:38.904788 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0e657506-1e96-4a16-a025-427757f0db48 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:19:38.907509 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0e657506-1e96-4a16-a025-427757f0db48 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962252c6-9c2c-4b81-bdb7-f6d317bada3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:19:39.070277 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0e657506-1e96-4a16-a025-427757f0db48 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.919998 May 19 12:19:39.076685 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 146/238] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:19:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 12:19:39.081953 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-505c3312-eacc-431a-8ba8-0fffd8ed2668 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:39.082864 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-505c3312-eacc-431a-8ba8-0fffd8ed2668 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:39.135538 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-2eef2657-643a-4241-a58c-5e768cc9a765 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:39.158279 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-2eef2657-643a-4241-a58c-5e768cc9a765 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.277202 May 19 12:19:39.172185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-505c3312-eacc-431a-8ba8-0fffd8ed2668 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:39.172698 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 93/239] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:38 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:39.189797 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-505c3312-eacc-431a-8ba8-0fffd8ed2668 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1214 microversion: 2.1 time: 0.111574 May 19 12:19:39.190466 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 147/240] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:39 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:40.185026 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f14b1db6-a0b0-4646-9762-d9e1f4f0cced tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:40.185758 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f14b1db6-a0b0-4646-9762-d9e1f4f0cced tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:40.203677 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f14b1db6-a0b0-4646-9762-d9e1f4f0cced tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:40.204276 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f14b1db6-a0b0-4646-9762-d9e1f4f0cced tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:40.205174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f14b1db6-a0b0-4646-9762-d9e1f4f0cced tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:40.206367 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f14b1db6-a0b0-4646-9762-d9e1f4f0cced tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:40.211425 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-488125b5-eab4-49a4-873f-058e57c1a95e req-569dcde2-4ee5-40c9-b908-6dd2a0f4573d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51363d7f-7d31-427b-87c1-fa437e713d85", "tag": "a5bc79ff-3cb4-40ee-b6c7-d0520edd0a76"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:19:40.233895 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-488125b5-eab4-49a4-873f-058e57c1a95e req-569dcde2-4ee5-40c9-b908-6dd2a0f4573d service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:40.234600 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-488125b5-eab4-49a4-873f-058e57c1a95e req-569dcde2-4ee5-40c9-b908-6dd2a0f4573d service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:40.263320 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-488125b5-eab4-49a4-873f-058e57c1a95e req-569dcde2-4ee5-40c9-b908-6dd2a0f4573d service nova] Creating event network-changed:a5bc79ff-3cb4-40ee-b6c7-d0520edd0a76 for instance 51363d7f-7d31-427b-87c1-fa437e713d85 on hv-cinder-80475 May 19 12:19:40.275064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-488125b5-eab4-49a4-873f-058e57c1a95e req-569dcde2-4ee5-40c9-b908-6dd2a0f4573d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068233 May 19 12:19:40.279114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 148/241] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:19:40.287835 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-aa6a9f61-8f65-43a8-86b9-566d4874d24b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:40.289357 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-aa6a9f61-8f65-43a8-86b9-566d4874d24b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:40.400274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-aa6a9f61-8f65-43a8-86b9-566d4874d24b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:40.410494 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-aa6a9f61-8f65-43a8-86b9-566d4874d24b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1214 microversion: 2.1 time: 0.126852 May 19 12:19:40.413022 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 149/242] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:40 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:40.434505 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f14b1db6-a0b0-4646-9762-d9e1f4f0cced tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:40.442964 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f14b1db6-a0b0-4646-9762-d9e1f4f0cced tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.266336 May 19 12:19:40.443671 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 94/243] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:40 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:41.434204 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-696003a7-55a0-413e-98cf-91ee668b4eb2 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:41.435534 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-696003a7-55a0-413e-98cf-91ee668b4eb2 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:41.441995 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-696003a7-55a0-413e-98cf-91ee668b4eb2 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:41.442458 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-696003a7-55a0-413e-98cf-91ee668b4eb2 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:41.443246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-696003a7-55a0-413e-98cf-91ee668b4eb2 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:41.443685 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-696003a7-55a0-413e-98cf-91ee668b4eb2 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:41.462036 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f3754333-08ab-4665-aae7-a557d34d0d13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:41.464934 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f3754333-08ab-4665-aae7-a557d34d0d13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:41.472205 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f3754333-08ab-4665-aae7-a557d34d0d13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:41.472938 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f3754333-08ab-4665-aae7-a557d34d0d13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:41.474144 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f3754333-08ab-4665-aae7-a557d34d0d13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:41.474781 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f3754333-08ab-4665-aae7-a557d34d0d13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:41.542593 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-696003a7-55a0-413e-98cf-91ee668b4eb2 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:41.554835 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-696003a7-55a0-413e-98cf-91ee668b4eb2 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1218 microversion: 2.1 time: 0.123827 May 19 12:19:41.555666 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 150/244] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:41 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:41.678272 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f3754333-08ab-4665-aae7-a557d34d0d13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:41.684867 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f3754333-08ab-4665-aae7-a557d34d0d13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1521 microversion: 2.1 time: 0.228558 May 19 12:19:41.685575 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 95/245] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:41 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:42.572104 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a0e8cdd8-66d0-412e-87ab-404b62f26678 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:42.572717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a0e8cdd8-66d0-412e-87ab-404b62f26678 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:42.584047 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0e8cdd8-66d0-412e-87ab-404b62f26678 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:42.584591 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0e8cdd8-66d0-412e-87ab-404b62f26678 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:42.586162 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0e8cdd8-66d0-412e-87ab-404b62f26678 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:42.586886 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0e8cdd8-66d0-412e-87ab-404b62f26678 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:42.659532 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a0e8cdd8-66d0-412e-87ab-404b62f26678 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:42.667498 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a0e8cdd8-66d0-412e-87ab-404b62f26678 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1210 microversion: 2.1 time: 0.099142 May 19 12:19:42.668749 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 151/246] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:42 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:42.702304 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-de95cd35-2227-4d6f-ba44-8bf963858f19 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:42.702864 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-de95cd35-2227-4d6f-ba44-8bf963858f19 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:42.705281 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=47 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:42.710231 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-de95cd35-2227-4d6f-ba44-8bf963858f19 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:42.711367 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-de95cd35-2227-4d6f-ba44-8bf963858f19 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:42.712176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-de95cd35-2227-4d6f-ba44-8bf963858f19 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:42.712797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-de95cd35-2227-4d6f-ba44-8bf963858f19 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:42.859849 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-de95cd35-2227-4d6f-ba44-8bf963858f19 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:42.871231 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-de95cd35-2227-4d6f-ba44-8bf963858f19 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1501 microversion: 2.1 time: 0.170194 May 19 12:19:42.871231 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 96/247] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:42 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1501 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:42.888054 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f6a8d552-92a7-417b-8cf6-efa72fd28731 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:42.888844 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f6a8d552-92a7-417b-8cf6-efa72fd28731 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:42.898968 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f6a8d552-92a7-417b-8cf6-efa72fd28731 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:42.900686 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f6a8d552-92a7-417b-8cf6-efa72fd28731 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:42.901947 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f6a8d552-92a7-417b-8cf6-efa72fd28731 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:42.902912 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f6a8d552-92a7-417b-8cf6-efa72fd28731 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:43.096093 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f6a8d552-92a7-417b-8cf6-efa72fd28731 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:43.103741 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f6a8d552-92a7-417b-8cf6-efa72fd28731 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1515 microversion: 2.1 time: 0.221720 May 19 12:19:43.104848 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 152/248] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:42 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1515 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:43.694642 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-2b7246c5-7ea5-4ef7-9bd0-e7f2a035f510 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:43.700553 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-2b7246c5-7ea5-4ef7-9bd0-e7f2a035f510 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:43.713536 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2b7246c5-7ea5-4ef7-9bd0-e7f2a035f510 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:43.714673 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2b7246c5-7ea5-4ef7-9bd0-e7f2a035f510 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:43.715501 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2b7246c5-7ea5-4ef7-9bd0-e7f2a035f510 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:43.715967 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2b7246c5-7ea5-4ef7-9bd0-e7f2a035f510 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:43.812707 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-2b7246c5-7ea5-4ef7-9bd0-e7f2a035f510 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:43.826959 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-2b7246c5-7ea5-4ef7-9bd0-e7f2a035f510 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1210 microversion: 2.1 time: 0.144975 May 19 12:19:43.827912 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 97/249] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:43 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1210 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:44.845778 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-dbcb9089-afdb-4c98-bf7e-8f60f1a14fe5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:44.858862 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-dbcb9089-afdb-4c98-bf7e-8f60f1a14fe5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:44.866109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbcb9089-afdb-4c98-bf7e-8f60f1a14fe5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:44.866684 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbcb9089-afdb-4c98-bf7e-8f60f1a14fe5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:44.867487 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbcb9089-afdb-4c98-bf7e-8f60f1a14fe5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:44.867911 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbcb9089-afdb-4c98-bf7e-8f60f1a14fe5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:44.950710 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a626009c-69a1-49d9-9449-adb73a00d655 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:44.951893 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a626009c-69a1-49d9-9449-adb73a00d655 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:44.966070 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a626009c-69a1-49d9-9449-adb73a00d655 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:44.967227 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a626009c-69a1-49d9-9449-adb73a00d655 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:44.968488 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a626009c-69a1-49d9-9449-adb73a00d655 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:44.972741 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a626009c-69a1-49d9-9449-adb73a00d655 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:44.978896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-dbcb9089-afdb-4c98-bf7e-8f60f1a14fe5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:44.982746 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:44.989331 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-dbcb9089-afdb-4c98-bf7e-8f60f1a14fe5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1266 microversion: 2.1 time: 0.148436 May 19 12:19:45.000204 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 153/250] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:44 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:45.001974 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a626009c-69a1-49d9-9449-adb73a00d655 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Going to try to terminate instance {{(pid=117964) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:19:45.477401 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a626009c-69a1-49d9-9449-adb73a00d655 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "DELETE /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 204 len: 0 microversion: 2.1 time: 0.530977 May 19 12:19:45.478595 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 98/251] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:19:44 2022] DELETE /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:19:45.487066 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ae896990-5f17-43b4-9c73-cb14d868e22b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:45.487771 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ae896990-5f17-43b4-9c73-cb14d868e22b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:45.494675 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae896990-5f17-43b4-9c73-cb14d868e22b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:45.496008 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae896990-5f17-43b4-9c73-cb14d868e22b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:45.496909 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae896990-5f17-43b4-9c73-cb14d868e22b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:45.497368 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae896990-5f17-43b4-9c73-cb14d868e22b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:45.645297 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ae896990-5f17-43b4-9c73-cb14d868e22b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:45.655832 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ae896990-5f17-43b4-9c73-cb14d868e22b tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1553 microversion: 2.1 time: 0.172642 May 19 12:19:45.656923 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 154/252] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:45 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:46.007843 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-fa7f8c19-db1b-4a86-8513-3d4fb0625fdd tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:46.009340 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-fa7f8c19-db1b-4a86-8513-3d4fb0625fdd tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:46.017079 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa7f8c19-db1b-4a86-8513-3d4fb0625fdd tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:46.017763 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa7f8c19-db1b-4a86-8513-3d4fb0625fdd tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:46.018541 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa7f8c19-db1b-4a86-8513-3d4fb0625fdd tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:46.018988 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa7f8c19-db1b-4a86-8513-3d4fb0625fdd tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:46.088613 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-fa7f8c19-db1b-4a86-8513-3d4fb0625fdd tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:46.096449 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-fa7f8c19-db1b-4a86-8513-3d4fb0625fdd tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1274 microversion: 2.1 time: 0.093343 May 19 12:19:46.107025 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 99/253] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:46 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:46.269183 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c9e2bca9-abba-47f8-99e6-80960b53a165 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:19:46.270231 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c9e2bca9-abba-47f8-99e6-80960b53a165 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:46.276873 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c9e2bca9-abba-47f8-99e6-80960b53a165 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:46.277362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c9e2bca9-abba-47f8-99e6-80960b53a165 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:46.278185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c9e2bca9-abba-47f8-99e6-80960b53a165 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:46.278549 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c9e2bca9-abba-47f8-99e6-80960b53a165 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:46.309995 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-c9e2bca9-abba-47f8-99e6-80960b53a165 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lazy-loading 'flavor' on Instance uuid b605d4a3-bf90-430f-b2c7-d037b473d29d {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:19:46.673232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-3c409777-d86d-42f2-8ccb-e9812291fc5a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:46.673864 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-3c409777-d86d-42f2-8ccb-e9812291fc5a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:46.684815 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3c409777-d86d-42f2-8ccb-e9812291fc5a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:46.685408 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3c409777-d86d-42f2-8ccb-e9812291fc5a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:46.686251 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3c409777-d86d-42f2-8ccb-e9812291fc5a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:46.686718 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3c409777-d86d-42f2-8ccb-e9812291fc5a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:46.738253 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c9e2bca9-abba-47f8-99e6-80960b53a165 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "POST /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d/action" status: 200 len: 32 microversion: 2.1 time: 0.472894 May 19 12:19:46.739744 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 155/254] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 19 12:19:46 2022] POST /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d/action => generated 32 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 12:19:46.749941 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3d4561aa-66b9-45f1-be9a-174547f5e1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:46.750939 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3d4561aa-66b9-45f1-be9a-174547f5e1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:46.758748 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3d4561aa-66b9-45f1-be9a-174547f5e1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:46.759489 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3d4561aa-66b9-45f1-be9a-174547f5e1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:46.770850 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3d4561aa-66b9-45f1-be9a-174547f5e1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:46.770850 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3d4561aa-66b9-45f1-be9a-174547f5e1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:46.921787 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-3c409777-d86d-42f2-8ccb-e9812291fc5a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:46.943827 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-3c409777-d86d-42f2-8ccb-e9812291fc5a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1553 microversion: 2.1 time: 0.274485 May 19 12:19:46.965091 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 100/255] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:46 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1553 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:46.980063 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3d4561aa-66b9-45f1-be9a-174547f5e1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:46.989415 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3d4561aa-66b9-45f1-be9a-174547f5e1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1521 microversion: 2.1 time: 0.243871 May 19 12:19:46.990395 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 156/256] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:46 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:47.115452 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-fa1a4ccf-2e30-4548-ad63-88d529ca0883 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:47.116153 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-fa1a4ccf-2e30-4548-ad63-88d529ca0883 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:47.124117 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa1a4ccf-2e30-4548-ad63-88d529ca0883 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:47.124731 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa1a4ccf-2e30-4548-ad63-88d529ca0883 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:47.125582 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa1a4ccf-2e30-4548-ad63-88d529ca0883 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:47.126091 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa1a4ccf-2e30-4548-ad63-88d529ca0883 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:47.216100 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-fa1a4ccf-2e30-4548-ad63-88d529ca0883 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:47.226793 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-fa1a4ccf-2e30-4548-ad63-88d529ca0883 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1274 microversion: 2.1 time: 0.115589 May 19 12:19:47.228037 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 101/257] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:47 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1274 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:47.967993 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e7312aa5-9c9d-4e81-92be-451822b3f19c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:47.968623 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e7312aa5-9c9d-4e81-92be-451822b3f19c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:47.975047 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e7312aa5-9c9d-4e81-92be-451822b3f19c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:47.975488 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e7312aa5-9c9d-4e81-92be-451822b3f19c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:47.976326 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e7312aa5-9c9d-4e81-92be-451822b3f19c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:47.976756 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e7312aa5-9c9d-4e81-92be-451822b3f19c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:48.019638 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-abc7d259-bebd-4b3d-a812-e7b886f23515 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:48.025982 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-abc7d259-bebd-4b3d-a812-e7b886f23515 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:48.033016 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-abc7d259-bebd-4b3d-a812-e7b886f23515 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:48.033995 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-abc7d259-bebd-4b3d-a812-e7b886f23515 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:48.035311 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-abc7d259-bebd-4b3d-a812-e7b886f23515 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:48.036040 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-abc7d259-bebd-4b3d-a812-e7b886f23515 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:48.278817 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e7312aa5-9c9d-4e81-92be-451822b3f19c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:48.287846 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e7312aa5-9c9d-4e81-92be-451822b3f19c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1553 microversion: 2.1 time: 0.323865 May 19 12:19:48.289236 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 157/258] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:47 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1553 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:48.294172 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1cb1f4b8-9193-4317-94e9-255b2eb79bd6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:48.295055 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1cb1f4b8-9193-4317-94e9-255b2eb79bd6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:48.302506 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1cb1f4b8-9193-4317-94e9-255b2eb79bd6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:48.303146 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1cb1f4b8-9193-4317-94e9-255b2eb79bd6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:48.305213 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1cb1f4b8-9193-4317-94e9-255b2eb79bd6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:48.305808 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1cb1f4b8-9193-4317-94e9-255b2eb79bd6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:48.394138 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-abc7d259-bebd-4b3d-a812-e7b886f23515 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:48.405005 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-abc7d259-bebd-4b3d-a812-e7b886f23515 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1521 microversion: 2.1 time: 0.402078 May 19 12:19:48.405961 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 102/259] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:48 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:48.588718 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1cb1f4b8-9193-4317-94e9-255b2eb79bd6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:48.604051 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1cb1f4b8-9193-4317-94e9-255b2eb79bd6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1314 microversion: 2.1 time: 0.310157 May 19 12:19:48.604891 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 158/260] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:48 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:49.040007 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-990cadc2-aeb6-480e-9736-35db9fa99d09 req-18cb5d69-7834-4e87-815d-3f23b784976e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86452401-2d6b-4b02-a61a-b5bd76cb996a", "name": "network-vif-deleted", "tag": "9b231795-5a6f-4362-ac0e-df73e6325281"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:19:49.049275 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-990cadc2-aeb6-480e-9736-35db9fa99d09 req-18cb5d69-7834-4e87-815d-3f23b784976e service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:49.049716 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-990cadc2-aeb6-480e-9736-35db9fa99d09 req-18cb5d69-7834-4e87-815d-3f23b784976e service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:49.063016 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-990cadc2-aeb6-480e-9736-35db9fa99d09 req-18cb5d69-7834-4e87-815d-3f23b784976e service nova] Creating event network-vif-deleted:9b231795-5a6f-4362-ac0e-df73e6325281 for instance 86452401-2d6b-4b02-a61a-b5bd76cb996a on hv-cinder-80475 May 19 12:19:49.069039 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-990cadc2-aeb6-480e-9736-35db9fa99d09 req-18cb5d69-7834-4e87-815d-3f23b784976e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033246 May 19 12:19:49.069897 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 103/261] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:19:49.308977 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e29c029e-479e-4c90-8858-68c45f76465c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:49.309873 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e29c029e-479e-4c90-8858-68c45f76465c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:49.314328 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:49.314328 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:49.317926 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e29c029e-479e-4c90-8858-68c45f76465c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:49.319030 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e29c029e-479e-4c90-8858-68c45f76465c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:49.320127 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e29c029e-479e-4c90-8858-68c45f76465c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:49.320768 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e29c029e-479e-4c90-8858-68c45f76465c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:49.397349 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e29c029e-479e-4c90-8858-68c45f76465c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:49.405600 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e29c029e-479e-4c90-8858-68c45f76465c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1345 microversion: 2.1 time: 0.104025 May 19 12:19:49.406536 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 159/262] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:49 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:49.423688 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e4eb9976-0544-4ab3-b912-be4ccc18c694 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:49.424595 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e4eb9976-0544-4ab3-b912-be4ccc18c694 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:49.432831 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e4eb9976-0544-4ab3-b912-be4ccc18c694 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:49.438914 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e4eb9976-0544-4ab3-b912-be4ccc18c694 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:49.438914 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e4eb9976-0544-4ab3-b912-be4ccc18c694 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:49.438914 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e4eb9976-0544-4ab3-b912-be4ccc18c694 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:49.588408 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e4eb9976-0544-4ab3-b912-be4ccc18c694 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:49.596800 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e4eb9976-0544-4ab3-b912-be4ccc18c694 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1521 microversion: 2.1 time: 0.177860 May 19 12:19:49.598019 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 104/263] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:49 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:49.628274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0f26a5c1-c2e5-4199-a68a-8627ed70120d tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:49.628910 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0f26a5c1-c2e5-4199-a68a-8627ed70120d tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:49.637028 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0f26a5c1-c2e5-4199-a68a-8627ed70120d tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:49.637484 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0f26a5c1-c2e5-4199-a68a-8627ed70120d tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:49.638362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0f26a5c1-c2e5-4199-a68a-8627ed70120d tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:49.638797 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0f26a5c1-c2e5-4199-a68a-8627ed70120d tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:49.800504 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0f26a5c1-c2e5-4199-a68a-8627ed70120d tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:49.802834 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0f26a5c1-c2e5-4199-a68a-8627ed70120d tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1314 microversion: 2.1 time: 0.178659 May 19 12:19:49.804244 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 160/264] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:49 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:49.998394 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-447f317e-8b50-4bf6-986d-98108671c3ab req-886b7b2f-ab20-4bd4-865f-506a16120107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20c7b346-edf5-4d57-ba2f-2530abe18632", "tag": "01ac3c6f-da80-4d77-80a9-e98853b9cebf"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:19:50.010014 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-447f317e-8b50-4bf6-986d-98108671c3ab req-886b7b2f-ab20-4bd4-865f-506a16120107 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:50.010970 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-447f317e-8b50-4bf6-986d-98108671c3ab req-886b7b2f-ab20-4bd4-865f-506a16120107 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:50.026304 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-447f317e-8b50-4bf6-986d-98108671c3ab req-886b7b2f-ab20-4bd4-865f-506a16120107 service nova] Creating event network-changed:01ac3c6f-da80-4d77-80a9-e98853b9cebf for instance 20c7b346-edf5-4d57-ba2f-2530abe18632 on hv-cinder-80475 May 19 12:19:50.030362 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-447f317e-8b50-4bf6-986d-98108671c3ab req-886b7b2f-ab20-4bd4-865f-506a16120107 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036927 May 19 12:19:50.031569 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 105/265] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:19:50.424644 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d1d9f895-222d-4984-afe3-7936f220ce0c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:50.425265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d1d9f895-222d-4984-afe3-7936f220ce0c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:50.427123 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=10 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:50.433028 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d1d9f895-222d-4984-afe3-7936f220ce0c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:50.433479 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d1d9f895-222d-4984-afe3-7936f220ce0c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:50.434258 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d1d9f895-222d-4984-afe3-7936f220ce0c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:50.434692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d1d9f895-222d-4984-afe3-7936f220ce0c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:50.467451 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d1d9f895-222d-4984-afe3-7936f220ce0c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:50.467974 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d1d9f895-222d-4984-afe3-7936f220ce0c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:50.468423 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-d1d9f895-222d-4984-afe3-7936f220ce0c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lazy-loading 'fault' on Instance uuid 86452401-2d6b-4b02-a61a-b5bd76cb996a {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:19:50.513454 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d1d9f895-222d-4984-afe3-7936f220ce0c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66a142d53340bb8bc4a0a9a9f48d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8f3490bba84ff38b5940fe768ede25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:50.521509 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d1d9f895-222d-4984-afe3-7936f220ce0c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 200 len: 1350 microversion: 2.1 time: 0.101412 May 19 12:19:50.522079 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 161/266] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:50 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 1350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:50.615950 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-10f7eb62-34a8-4c52-ae10-689b2187786d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:50.617233 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-10f7eb62-34a8-4c52-ae10-689b2187786d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:50.623713 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-10f7eb62-34a8-4c52-ae10-689b2187786d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:50.624434 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-10f7eb62-34a8-4c52-ae10-689b2187786d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:50.625217 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-10f7eb62-34a8-4c52-ae10-689b2187786d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:50.625839 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-10f7eb62-34a8-4c52-ae10-689b2187786d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:50.630018 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:50.780061 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-10f7eb62-34a8-4c52-ae10-689b2187786d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:50.788997 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-10f7eb62-34a8-4c52-ae10-689b2187786d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1521 microversion: 2.1 time: 0.177911 May 19 12:19:50.789838 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 106/267] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:50 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:50.822422 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4bf3e865-66b8-40cc-9ba9-2519df6eb424 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:50.822932 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4bf3e865-66b8-40cc-9ba9-2519df6eb424 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:50.829410 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4bf3e865-66b8-40cc-9ba9-2519df6eb424 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:50.829947 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4bf3e865-66b8-40cc-9ba9-2519df6eb424 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:50.830626 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4bf3e865-66b8-40cc-9ba9-2519df6eb424 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:50.831028 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4bf3e865-66b8-40cc-9ba9-2519df6eb424 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:51.013472 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4bf3e865-66b8-40cc-9ba9-2519df6eb424 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:51.024282 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4bf3e865-66b8-40cc-9ba9-2519df6eb424 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1314 microversion: 2.1 time: 0.206002 May 19 12:19:51.030007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 162/268] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:50 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:51.539545 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-dafe0ac9-6e57-43e5-9aa2-f7b570aab50c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:51.539837 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-dafe0ac9-6e57-43e5-9aa2-f7b570aab50c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:51.546222 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dafe0ac9-6e57-43e5-9aa2-f7b570aab50c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:51.546673 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dafe0ac9-6e57-43e5-9aa2-f7b570aab50c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:51.547459 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dafe0ac9-6e57-43e5-9aa2-f7b570aab50c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:51.547928 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dafe0ac9-6e57-43e5-9aa2-f7b570aab50c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:51.565142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-dafe0ac9-6e57-43e5-9aa2-f7b570aab50c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] HTTP exception thrown: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-dafe0ac9-6e57-43e5-9aa2-f7b570aab50c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Request method failure captured: May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a HTTP/1.1 May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjVvSXKdhhFfeApkJ87rOsoaqx90CPi85qhQ_H8thSi2IEIBa0Tq2A1Ts8CymeqYXt_Dezq_e_P4yZg3X4eLd3cC4dWVQPHBw7GdECpwxRWCaNJgM5UKT6ZZkKNJ-uGCnTfvUwAHSzH4ykvmHODKpdRUkeywLXnV2NQSPsgDSprKjAM May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: de8f3490bba84ff38b5940fe768ede25 May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-DeleteServersTestJSON-1381376680 May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:19:51.588143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:19:51.589713 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de8f3490bba84ff38b5940fe768ede25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de8f3490bba84ff38b5940fe768ede25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de8f3490bba84ff38b5940fe768ede25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de8f3490bba84ff38b5940fe768ede25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:19:51.589713 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-DeleteServersTestJSON-1381376680 May 19 12:19:51.589713 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: de8f3490bba84ff38b5940fe768ede25 May 19 12:19:51.589713 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381376680 May 19 12:19:51.589713 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-DeleteServersTestJSON-1381376680-project May 19 12:19:51.589713 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:19:51.589713 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:19:51.589713 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: 9e66a142d53340bb8bc4a0a9a9f48d59 May 19 12:19:51.589713 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-DeleteServersTestJSON-1381376680-project May 19 12:19:51.589713 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:19:51.589713 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:51.589713 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': '86452401-2d6b-4b02-a61a-b5bd76cb996a'} May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:19:51.590544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:19:51.591991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:19:51.591991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:19:51.591991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:19:51.591991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:19:51.591991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:19:51.591991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:19:51.591991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:19:51.591991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:51.591991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:19:51.591991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:19:51.591991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:19:51.591991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:19:51.591991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:19:51.591991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:19:51.591991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:19:51.591991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:19:51.591991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:51.591991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:19:51.593196 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-dafe0ac9-6e57-43e5-9aa2-f7b570aab50c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Returning 404 to user: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:19:51.593196 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-dafe0ac9-6e57-43e5-9aa2-f7b570aab50c tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 404 len: 111 microversion: 2.1 time: 0.054759 May 19 12:19:51.593196 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 107/269] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:51 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:19:51.703707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f05f011e-a971-4390-afd3-ccb2396b0900 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:51.704765 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f05f011e-a971-4390-afd3-ccb2396b0900 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:51.711950 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f05f011e-a971-4390-afd3-ccb2396b0900 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:51.712410 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f05f011e-a971-4390-afd3-ccb2396b0900 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:51.713175 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f05f011e-a971-4390-afd3-ccb2396b0900 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:51.713611 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f05f011e-a971-4390-afd3-ccb2396b0900 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:51.727373 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-f05f011e-a971-4390-afd3-ccb2396b0900 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] HTTP exception thrown: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f05f011e-a971-4390-afd3-ccb2396b0900 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Request method failure captured: May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a/os-volume_attachments HTTP/1.1 May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjVvSXKdhhFfeApkJ87rOsoaqx90CPi85qhQ_H8thSi2IEIBa0Tq2A1Ts8CymeqYXt_Dezq_e_P4yZg3X4eLd3cC4dWVQPHBw7GdECpwxRWCaNJgM5UKT6ZZkKNJ-uGCnTfvUwAHSzH4ykvmHODKpdRUkeywLXnV2NQSPsgDSprKjAM May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: de8f3490bba84ff38b5940fe768ede25 May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-DeleteServersTestJSON-1381376680 May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:19:51.731707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:19:51.733458 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de8f3490bba84ff38b5940fe768ede25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de8f3490bba84ff38b5940fe768ede25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de8f3490bba84ff38b5940fe768ede25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de8f3490bba84ff38b5940fe768ede25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:19:51.733458 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-DeleteServersTestJSON-1381376680 May 19 12:19:51.733458 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: de8f3490bba84ff38b5940fe768ede25 May 19 12:19:51.733458 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381376680 May 19 12:19:51.733458 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-DeleteServersTestJSON-1381376680-project May 19 12:19:51.733458 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:19:51.733458 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:19:51.733458 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: 9e66a142d53340bb8bc4a0a9a9f48d59 May 19 12:19:51.733458 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-DeleteServersTestJSON-1381376680-project May 19 12:19:51.733458 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:19:51.733458 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:51.733458 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'server_id': '86452401-2d6b-4b02-a61a-b5bd76cb996a'} May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:19:51.734268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:51.735424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:19:51.736513 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f05f011e-a971-4390-afd3-ccb2396b0900 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Returning 404 to user: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:19:51.736513 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f05f011e-a971-4390-afd3-ccb2396b0900 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033556 May 19 12:19:51.736513 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 163/270] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:19:51 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:19:51.806900 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-34354d20-bd7a-4423-82dc-117164f75e86 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:51.807482 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-34354d20-bd7a-4423-82dc-117164f75e86 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:51.816224 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-34354d20-bd7a-4423-82dc-117164f75e86 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:51.816680 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-34354d20-bd7a-4423-82dc-117164f75e86 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:51.817464 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-34354d20-bd7a-4423-82dc-117164f75e86 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:51.817905 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-34354d20-bd7a-4423-82dc-117164f75e86 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:51.952631 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-34354d20-bd7a-4423-82dc-117164f75e86 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:51.962191 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-34354d20-bd7a-4423-82dc-117164f75e86 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1521 microversion: 2.1 time: 0.160182 May 19 12:19:51.962795 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 108/271] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:51 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:52.043154 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a21d1f4c-8eb2-43a8-825b-8220ff5fa0fc tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:52.043770 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a21d1f4c-8eb2-43a8-825b-8220ff5fa0fc tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:52.049884 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a21d1f4c-8eb2-43a8-825b-8220ff5fa0fc tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:52.050333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a21d1f4c-8eb2-43a8-825b-8220ff5fa0fc tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:52.051154 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a21d1f4c-8eb2-43a8-825b-8220ff5fa0fc tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:52.051541 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a21d1f4c-8eb2-43a8-825b-8220ff5fa0fc tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:52.190302 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a21d1f4c-8eb2-43a8-825b-8220ff5fa0fc tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:52.200392 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a21d1f4c-8eb2-43a8-825b-8220ff5fa0fc tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1314 microversion: 2.1 time: 0.161572 May 19 12:19:52.200961 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 164/272] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:52 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:52.980635 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b287d0c7-7083-42a8-bf73-96647d62119b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:52.981431 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-b287d0c7-7083-42a8-bf73-96647d62119b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:52.988584 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b287d0c7-7083-42a8-bf73-96647d62119b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:52.989083 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b287d0c7-7083-42a8-bf73-96647d62119b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:52.989909 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b287d0c7-7083-42a8-bf73-96647d62119b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:52.990338 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b287d0c7-7083-42a8-bf73-96647d62119b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:53.127997 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b287d0c7-7083-42a8-bf73-96647d62119b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:53.137040 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b287d0c7-7083-42a8-bf73-96647d62119b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1521 microversion: 2.1 time: 0.161146 May 19 12:19:53.137619 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 109/273] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:52 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:53.218357 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bc14a218-ff6c-4880-a116-842ab1bcc1ca tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:53.219136 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bc14a218-ff6c-4880-a116-842ab1bcc1ca tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:53.226528 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bc14a218-ff6c-4880-a116-842ab1bcc1ca tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:53.227365 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bc14a218-ff6c-4880-a116-842ab1bcc1ca tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:53.228274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bc14a218-ff6c-4880-a116-842ab1bcc1ca tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:53.228884 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bc14a218-ff6c-4880-a116-842ab1bcc1ca tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:53.368428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bc14a218-ff6c-4880-a116-842ab1bcc1ca tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:53.376361 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bc14a218-ff6c-4880-a116-842ab1bcc1ca tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1314 microversion: 2.1 time: 0.162513 May 19 12:19:53.376938 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 165/274] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:53 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:54.156271 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-966f7a2a-7cb2-46f8-bfc7-6faabff1faa9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:54.156918 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-966f7a2a-7cb2-46f8-bfc7-6faabff1faa9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:54.163813 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-966f7a2a-7cb2-46f8-bfc7-6faabff1faa9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:54.164354 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-966f7a2a-7cb2-46f8-bfc7-6faabff1faa9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:54.165133 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-966f7a2a-7cb2-46f8-bfc7-6faabff1faa9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:54.165606 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-966f7a2a-7cb2-46f8-bfc7-6faabff1faa9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:54.240089 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-247bba08-4771-48c5-a754-b109ada5bd5a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:54.241221 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-247bba08-4771-48c5-a754-b109ada5bd5a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:54.248757 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-247bba08-4771-48c5-a754-b109ada5bd5a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:54.249214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-247bba08-4771-48c5-a754-b109ada5bd5a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:54.249983 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-247bba08-4771-48c5-a754-b109ada5bd5a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:54.250416 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-247bba08-4771-48c5-a754-b109ada5bd5a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:54.266003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-247bba08-4771-48c5-a754-b109ada5bd5a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] HTTP exception thrown: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-247bba08-4771-48c5-a754-b109ada5bd5a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Request method failure captured: May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: DELETE /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a HTTP/1.1 May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjVvSXKdhhFfeApkJ87rOsoaqx90CPi85qhQ_H8thSi2IEIBa0Tq2A1Ts8CymeqYXt_Dezq_e_P4yZg3X4eLd3cC4dWVQPHBw7GdECpwxRWCaNJgM5UKT6ZZkKNJ-uGCnTfvUwAHSzH4ykvmHODKpdRUkeywLXnV2NQSPsgDSprKjAM May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: de8f3490bba84ff38b5940fe768ede25 May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-DeleteServersTestJSON-1381376680 May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:19:54.268261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:19:54.271752 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de8f3490bba84ff38b5940fe768ede25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de8f3490bba84ff38b5940fe768ede25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de8f3490bba84ff38b5940fe768ede25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de8f3490bba84ff38b5940fe768ede25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:19:54.271752 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-DeleteServersTestJSON-1381376680 May 19 12:19:54.271752 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: de8f3490bba84ff38b5940fe768ede25 May 19 12:19:54.271752 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381376680 May 19 12:19:54.271752 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-DeleteServersTestJSON-1381376680-project May 19 12:19:54.271752 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:19:54.271752 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:19:54.271752 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: 9e66a142d53340bb8bc4a0a9a9f48d59 May 19 12:19:54.271752 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-DeleteServersTestJSON-1381376680-project May 19 12:19:54.271752 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:19:54.271752 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:54.271752 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': '86452401-2d6b-4b02-a61a-b5bd76cb996a'} May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:19:54.272648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:54.274405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:19:54.275947 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-247bba08-4771-48c5-a754-b109ada5bd5a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Returning 404 to user: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:19:54.275947 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-247bba08-4771-48c5-a754-b109ada5bd5a tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "DELETE /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 404 len: 111 microversion: 2.1 time: 0.033646 May 19 12:19:54.275947 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 166/275] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:19:54 2022] DELETE /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:19:54.278851 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8d3f874b-a0c3-405d-a1e9-d0d2fb4f2213 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:54.279465 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8d3f874b-a0c3-405d-a1e9-d0d2fb4f2213 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] [instance: 86452401-2d6b-4b02-a61a-b5bd76cb996a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:54.285774 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8d3f874b-a0c3-405d-a1e9-d0d2fb4f2213 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:54.286224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8d3f874b-a0c3-405d-a1e9-d0d2fb4f2213 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:54.286999 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8d3f874b-a0c3-405d-a1e9-d0d2fb4f2213 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:54.287430 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8d3f874b-a0c3-405d-a1e9-d0d2fb4f2213 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:54.302357 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-8d3f874b-a0c3-405d-a1e9-d0d2fb4f2213 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] HTTP exception thrown: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8d3f874b-a0c3-405d-a1e9-d0d2fb4f2213 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Request method failure captured: May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a HTTP/1.1 May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjVvSXKdhhFfeApkJ87rOsoaqx90CPi85qhQ_H8thSi2IEIBa0Tq2A1Ts8CymeqYXt_Dezq_e_P4yZg3X4eLd3cC4dWVQPHBw7GdECpwxRWCaNJgM5UKT6ZZkKNJ-uGCnTfvUwAHSzH4ykvmHODKpdRUkeywLXnV2NQSPsgDSprKjAM May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: de8f3490bba84ff38b5940fe768ede25 May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-DeleteServersTestJSON-1381376680 May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:19:54.303925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:19:54.307554 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de8f3490bba84ff38b5940fe768ede25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de8f3490bba84ff38b5940fe768ede25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de8f3490bba84ff38b5940fe768ede25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de8f3490bba84ff38b5940fe768ede25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:19:54.307554 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-DeleteServersTestJSON-1381376680 May 19 12:19:54.307554 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: de8f3490bba84ff38b5940fe768ede25 May 19 12:19:54.307554 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381376680 May 19 12:19:54.307554 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-DeleteServersTestJSON-1381376680-project May 19 12:19:54.307554 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:19:54.307554 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:19:54.307554 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: 9e66a142d53340bb8bc4a0a9a9f48d59 May 19 12:19:54.307554 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-DeleteServersTestJSON-1381376680-project May 19 12:19:54.307554 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:19:54.307554 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:54.307554 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': '86452401-2d6b-4b02-a61a-b5bd76cb996a'} May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:19:54.309135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:19:54.311461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:19:54.311461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:19:54.311461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:19:54.311461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:19:54.311461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:19:54.311461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:19:54.311461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:19:54.311461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:54.311461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:19:54.311461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:19:54.311461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:19:54.311461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:19:54.311461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:19:54.311461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:19:54.311461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:19:54.311461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:19:54.311461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. May 19 12:19:54.311461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:19:54.315312 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8d3f874b-a0c3-405d-a1e9-d0d2fb4f2213 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] Returning 404 to user: Instance 86452401-2d6b-4b02-a61a-b5bd76cb996a could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:19:54.315312 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8d3f874b-a0c3-405d-a1e9-d0d2fb4f2213 tempest-DeleteServersTestJSON-1381376680 tempest-DeleteServersTestJSON-1381376680-project] 10.222.0.23 "GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a" status: 404 len: 111 microversion: 2.1 time: 0.031639 May 19 12:19:54.315312 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 167/276] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:54 2022] GET /compute/v2.1/servers/86452401-2d6b-4b02-a61a-b5bd76cb996a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:19:54.330527 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-966f7a2a-7cb2-46f8-bfc7-6faabff1faa9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:54.341296 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-966f7a2a-7cb2-46f8-bfc7-6faabff1faa9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1521 microversion: 2.1 time: 0.189361 May 19 12:19:54.341919 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 110/277] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:54 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:54.393584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-32a0d2de-e78c-429d-ab5c-0368ee275ca8 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:54.394374 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-32a0d2de-e78c-429d-ab5c-0368ee275ca8 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:54.403210 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-32a0d2de-e78c-429d-ab5c-0368ee275ca8 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:54.403679 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-32a0d2de-e78c-429d-ab5c-0368ee275ca8 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:54.404528 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-32a0d2de-e78c-429d-ab5c-0368ee275ca8 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:54.404961 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-32a0d2de-e78c-429d-ab5c-0368ee275ca8 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:54.563172 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-32a0d2de-e78c-429d-ab5c-0368ee275ca8 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:54.572827 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-32a0d2de-e78c-429d-ab5c-0368ee275ca8 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1314 microversion: 2.1 time: 0.183019 May 19 12:19:54.573494 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 168/278] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:54 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:55.360139 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-be2994e1-cd57-40b3-b5a3-d4877db3b4f3 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:55.361185 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-be2994e1-cd57-40b3-b5a3-d4877db3b4f3 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:55.369302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-be2994e1-cd57-40b3-b5a3-d4877db3b4f3 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:55.369752 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-be2994e1-cd57-40b3-b5a3-d4877db3b4f3 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:55.370530 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-be2994e1-cd57-40b3-b5a3-d4877db3b4f3 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:55.370968 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-be2994e1-cd57-40b3-b5a3-d4877db3b4f3 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:55.546023 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-be2994e1-cd57-40b3-b5a3-d4877db3b4f3 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:55.555157 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-be2994e1-cd57-40b3-b5a3-d4877db3b4f3 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1521 microversion: 2.1 time: 0.199647 May 19 12:19:55.555643 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 111/279] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:55 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:55.591030 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a90b9e5d-0039-4fdd-8bf4-09b41b0ff003 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:55.591637 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a90b9e5d-0039-4fdd-8bf4-09b41b0ff003 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:55.597700 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a90b9e5d-0039-4fdd-8bf4-09b41b0ff003 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:55.598140 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a90b9e5d-0039-4fdd-8bf4-09b41b0ff003 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:55.598951 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a90b9e5d-0039-4fdd-8bf4-09b41b0ff003 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:55.599380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a90b9e5d-0039-4fdd-8bf4-09b41b0ff003 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:55.752398 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a90b9e5d-0039-4fdd-8bf4-09b41b0ff003 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:55.761187 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a90b9e5d-0039-4fdd-8bf4-09b41b0ff003 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1314 microversion: 2.1 time: 0.174062 May 19 12:19:55.762022 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 169/280] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:55 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:56.573115 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-496e9e52-22e9-4c99-8056-798206155676 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:56.573679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-496e9e52-22e9-4c99-8056-798206155676 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:56.580583 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-496e9e52-22e9-4c99-8056-798206155676 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:56.581025 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-496e9e52-22e9-4c99-8056-798206155676 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:56.581855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-496e9e52-22e9-4c99-8056-798206155676 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:56.582288 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-496e9e52-22e9-4c99-8056-798206155676 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:56.776424 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-496e9e52-22e9-4c99-8056-798206155676 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:56.779164 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-402b4c23-12a9-4a45-b390-405989dbfee1 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:56.779772 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-402b4c23-12a9-4a45-b390-405989dbfee1 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:56.791251 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-402b4c23-12a9-4a45-b390-405989dbfee1 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:56.791694 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-402b4c23-12a9-4a45-b390-405989dbfee1 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:56.792502 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-402b4c23-12a9-4a45-b390-405989dbfee1 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:56.792933 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-402b4c23-12a9-4a45-b390-405989dbfee1 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:56.797277 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:56.806496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-496e9e52-22e9-4c99-8056-798206155676 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1521 microversion: 2.1 time: 0.238061 May 19 12:19:56.807471 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 112/281] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:56 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:56.963496 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-402b4c23-12a9-4a45-b390-405989dbfee1 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:56.972441 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-402b4c23-12a9-4a45-b390-405989dbfee1 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1314 microversion: 2.1 time: 0.197117 May 19 12:19:56.973024 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 170/282] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:56 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:57.831779 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-31718c23-28a1-4791-aa41-0dab82a09e3f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:57.832642 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-31718c23-28a1-4791-aa41-0dab82a09e3f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:57.845471 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-31718c23-28a1-4791-aa41-0dab82a09e3f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:57.845962 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-31718c23-28a1-4791-aa41-0dab82a09e3f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:57.847021 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-31718c23-28a1-4791-aa41-0dab82a09e3f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:57.855451 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-31718c23-28a1-4791-aa41-0dab82a09e3f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:57.990292 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-875eff10-ecd0-486c-96d9-2b2cd044979f tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:57.992027 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-875eff10-ecd0-486c-96d9-2b2cd044979f tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:57.997983 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-31718c23-28a1-4791-aa41-0dab82a09e3f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:58.000695 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-875eff10-ecd0-486c-96d9-2b2cd044979f tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:58.001265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-875eff10-ecd0-486c-96d9-2b2cd044979f tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:58.002122 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-875eff10-ecd0-486c-96d9-2b2cd044979f tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:58.002566 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-875eff10-ecd0-486c-96d9-2b2cd044979f tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:58.008059 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-31718c23-28a1-4791-aa41-0dab82a09e3f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1521 microversion: 2.1 time: 0.179496 May 19 12:19:58.009941 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 113/283] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:57 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:58.163745 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-875eff10-ecd0-486c-96d9-2b2cd044979f tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:58.179885 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-875eff10-ecd0-486c-96d9-2b2cd044979f tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1314 microversion: 2.1 time: 0.192935 May 19 12:19:58.185104 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 171/284] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:57 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:19:58.488154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-9583c713-668c-48a5-9338-ce66ec4e4d79 req-52923e24-9e54-47d4-a2ee-9ccf9b7d6027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c7b346-edf5-4d57-ba2f-2530abe18632", "name": "network-vif-plugged", "status": "completed", "tag": "01ac3c6f-da80-4d77-80a9-e98853b9cebf"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:19:58.501670 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-9583c713-668c-48a5-9338-ce66ec4e4d79 req-52923e24-9e54-47d4-a2ee-9ccf9b7d6027 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:58.502202 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-9583c713-668c-48a5-9338-ce66ec4e4d79 req-52923e24-9e54-47d4-a2ee-9ccf9b7d6027 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:58.514111 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-9583c713-668c-48a5-9338-ce66ec4e4d79 req-52923e24-9e54-47d4-a2ee-9ccf9b7d6027 service nova] Creating event network-vif-plugged:01ac3c6f-da80-4d77-80a9-e98853b9cebf for instance 20c7b346-edf5-4d57-ba2f-2530abe18632 on hv-cinder-80475 May 19 12:19:58.520003 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-9583c713-668c-48a5-9338-ce66ec4e4d79 req-52923e24-9e54-47d4-a2ee-9ccf9b7d6027 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035416 May 19 12:19:58.520609 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 114/285] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:19:59.027490 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6a09420d-7a8c-44e3-9d48-48aea84f4d2b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:59.028347 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6a09420d-7a8c-44e3-9d48-48aea84f4d2b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:59.034867 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a09420d-7a8c-44e3-9d48-48aea84f4d2b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:59.035363 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a09420d-7a8c-44e3-9d48-48aea84f4d2b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:59.036170 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a09420d-7a8c-44e3-9d48-48aea84f4d2b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:59.036613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a09420d-7a8c-44e3-9d48-48aea84f4d2b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:59.177539 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6a09420d-7a8c-44e3-9d48-48aea84f4d2b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:59.186096 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6a09420d-7a8c-44e3-9d48-48aea84f4d2b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1521 microversion: 2.1 time: 0.163620 May 19 12:19:59.187344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 172/286] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:59 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:19:59.201400 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a44d2963-f149-48e0-a2cc-91bdc6fea1fb tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:19:59.202106 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a44d2963-f149-48e0-a2cc-91bdc6fea1fb tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:19:59.208957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a44d2963-f149-48e0-a2cc-91bdc6fea1fb tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:59.209415 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a44d2963-f149-48e0-a2cc-91bdc6fea1fb tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:59.210229 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a44d2963-f149-48e0-a2cc-91bdc6fea1fb tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:19:59.210695 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a44d2963-f149-48e0-a2cc-91bdc6fea1fb tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:19:59.349278 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a44d2963-f149-48e0-a2cc-91bdc6fea1fb tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:19:59.358061 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a44d2963-f149-48e0-a2cc-91bdc6fea1fb tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1314 microversion: 2.1 time: 0.160733 May 19 12:19:59.364439 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 115/287] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:19:59 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:00.203067 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f5c8863e-98b3-4654-a2c9-991cb8966f57 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:00.203712 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f5c8863e-98b3-4654-a2c9-991cb8966f57 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:00.210635 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f5c8863e-98b3-4654-a2c9-991cb8966f57 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:00.211095 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f5c8863e-98b3-4654-a2c9-991cb8966f57 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:00.212047 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f5c8863e-98b3-4654-a2c9-991cb8966f57 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:00.212342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f5c8863e-98b3-4654-a2c9-991cb8966f57 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:00.375995 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ff0d23cf-8311-46ed-ab68-e3a3c6f30a29 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:00.377201 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ff0d23cf-8311-46ed-ab68-e3a3c6f30a29 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:00.391995 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ff0d23cf-8311-46ed-ab68-e3a3c6f30a29 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:00.391995 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ff0d23cf-8311-46ed-ab68-e3a3c6f30a29 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:00.392241 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f5c8863e-98b3-4654-a2c9-991cb8966f57 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:00.392340 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ff0d23cf-8311-46ed-ab68-e3a3c6f30a29 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:00.392340 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ff0d23cf-8311-46ed-ab68-e3a3c6f30a29 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:00.393583 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f5c8863e-98b3-4654-a2c9-991cb8966f57 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1521 microversion: 2.1 time: 0.194802 May 19 12:20:00.394162 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 173/288] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:00 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:00.539619 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ff0d23cf-8311-46ed-ab68-e3a3c6f30a29 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:00.546112 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ff0d23cf-8311-46ed-ab68-e3a3c6f30a29 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1314 microversion: 2.1 time: 0.174106 May 19 12:20:00.546904 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 116/289] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:00 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:20:01.416039 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-223cce6b-4525-4fa8-a742-aad96f063989 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:01.417158 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-223cce6b-4525-4fa8-a742-aad96f063989 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:01.439357 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-223cce6b-4525-4fa8-a742-aad96f063989 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:01.440182 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-223cce6b-4525-4fa8-a742-aad96f063989 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:01.441518 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-223cce6b-4525-4fa8-a742-aad96f063989 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:01.443480 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-223cce6b-4525-4fa8-a742-aad96f063989 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:01.565852 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b8cfd318-97c4-43b3-a2ce-fc83781a4426 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:01.566517 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-b8cfd318-97c4-43b3-a2ce-fc83781a4426 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:01.581817 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b8cfd318-97c4-43b3-a2ce-fc83781a4426 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:01.582724 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b8cfd318-97c4-43b3-a2ce-fc83781a4426 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:01.583772 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b8cfd318-97c4-43b3-a2ce-fc83781a4426 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:01.584809 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b8cfd318-97c4-43b3-a2ce-fc83781a4426 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:01.832224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-223cce6b-4525-4fa8-a742-aad96f063989 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:01.840676 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-223cce6b-4525-4fa8-a742-aad96f063989 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1521 microversion: 2.1 time: 0.432493 May 19 12:20:01.841364 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 174/290] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:01 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:01.846700 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b8cfd318-97c4-43b3-a2ce-fc83781a4426 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:01.866167 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b8cfd318-97c4-43b3-a2ce-fc83781a4426 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1499 microversion: 2.1 time: 0.295463 May 19 12:20:01.866167 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 117/291] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:01 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1499 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:20:02.861865 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7d0567b7-d836-4899-8927-43517cce25d2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:02.869664 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7d0567b7-d836-4899-8927-43517cce25d2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:02.877812 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7d0567b7-d836-4899-8927-43517cce25d2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:02.879303 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7d0567b7-d836-4899-8927-43517cce25d2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:02.880397 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7d0567b7-d836-4899-8927-43517cce25d2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:02.880993 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7d0567b7-d836-4899-8927-43517cce25d2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:03.139981 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7d0567b7-d836-4899-8927-43517cce25d2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:03.150334 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7d0567b7-d836-4899-8927-43517cce25d2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1521 microversion: 2.1 time: 0.294376 May 19 12:20:03.154430 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 175/292] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:02 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:03.245109 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-1ec45c08-d16b-4704-a7d9-b6c1a96edc26 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:03.245654 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-1ec45c08-d16b-4704-a7d9-b6c1a96edc26 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:03.255916 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1ec45c08-d16b-4704-a7d9-b6c1a96edc26 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:03.256468 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1ec45c08-d16b-4704-a7d9-b6c1a96edc26 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:03.260868 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1ec45c08-d16b-4704-a7d9-b6c1a96edc26 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:03.261596 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1ec45c08-d16b-4704-a7d9-b6c1a96edc26 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:03.332240 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-1ec45c08-d16b-4704-a7d9-b6c1a96edc26 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Going to try to terminate instance {{(pid=117964) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:20:03.750556 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-1ec45c08-d16b-4704-a7d9-b6c1a96edc26 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "DELETE /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 204 len: 0 microversion: 2.1 time: 0.509768 May 19 12:20:03.755987 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 118/293] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:20:03 2022] DELETE /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:20:03.761380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-237794cf-8bf4-47d3-b595-c00cf1b9e687 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:03.763762 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-237794cf-8bf4-47d3-b595-c00cf1b9e687 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:03.773125 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-237794cf-8bf4-47d3-b595-c00cf1b9e687 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:03.773977 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-237794cf-8bf4-47d3-b595-c00cf1b9e687 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:03.775216 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-237794cf-8bf4-47d3-b595-c00cf1b9e687 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:03.776405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-237794cf-8bf4-47d3-b595-c00cf1b9e687 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:04.034183 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-237794cf-8bf4-47d3-b595-c00cf1b9e687 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:04.042941 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-237794cf-8bf4-47d3-b595-c00cf1b9e687 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1505 microversion: 2.1 time: 0.286087 May 19 12:20:04.043587 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 176/294] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:03 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1505 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:04.178854 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-448fd350-b137-48d2-ac3b-d4102bcc7974 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:04.179761 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-448fd350-b137-48d2-ac3b-d4102bcc7974 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:04.188508 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-448fd350-b137-48d2-ac3b-d4102bcc7974 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:04.189030 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-448fd350-b137-48d2-ac3b-d4102bcc7974 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:04.189826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-448fd350-b137-48d2-ac3b-d4102bcc7974 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:04.190319 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-448fd350-b137-48d2-ac3b-d4102bcc7974 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:04.374224 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-448fd350-b137-48d2-ac3b-d4102bcc7974 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:04.384043 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-448fd350-b137-48d2-ac3b-d4102bcc7974 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1521 microversion: 2.1 time: 0.210543 May 19 12:20:04.390000 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 119/295] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:04 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:05.062042 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f42a7d84-a138-4edd-9ff3-91bc32ebebf7 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:05.063416 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f42a7d84-a138-4edd-9ff3-91bc32ebebf7 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:05.070844 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f42a7d84-a138-4edd-9ff3-91bc32ebebf7 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:05.071800 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f42a7d84-a138-4edd-9ff3-91bc32ebebf7 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:05.073212 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f42a7d84-a138-4edd-9ff3-91bc32ebebf7 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:05.074107 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f42a7d84-a138-4edd-9ff3-91bc32ebebf7 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:05.307753 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f42a7d84-a138-4edd-9ff3-91bc32ebebf7 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:05.316428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f42a7d84-a138-4edd-9ff3-91bc32ebebf7 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1505 microversion: 2.1 time: 0.258309 May 19 12:20:05.317686 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 177/296] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:05 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:05.401741 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-7bba93be-7db4-4ffb-93d4-a7931bb764e7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:05.402353 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-7bba93be-7db4-4ffb-93d4-a7931bb764e7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:05.411519 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7bba93be-7db4-4ffb-93d4-a7931bb764e7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:05.411519 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7bba93be-7db4-4ffb-93d4-a7931bb764e7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:05.411519 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7bba93be-7db4-4ffb-93d4-a7931bb764e7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:05.411519 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7bba93be-7db4-4ffb-93d4-a7931bb764e7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:05.573507 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-7bba93be-7db4-4ffb-93d4-a7931bb764e7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:05.581426 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-7bba93be-7db4-4ffb-93d4-a7931bb764e7 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1521 microversion: 2.1 time: 0.183926 May 19 12:20:05.581998 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 120/297] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:05 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:06.334554 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-afcb4cf8-419f-4e4a-9e90-f309e05418ff tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:06.336264 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-afcb4cf8-419f-4e4a-9e90-f309e05418ff tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:06.350040 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-afcb4cf8-419f-4e4a-9e90-f309e05418ff tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:06.350647 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-afcb4cf8-419f-4e4a-9e90-f309e05418ff tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:06.356221 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-afcb4cf8-419f-4e4a-9e90-f309e05418ff tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:06.357092 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-afcb4cf8-419f-4e4a-9e90-f309e05418ff tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:06.566828 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-afcb4cf8-419f-4e4a-9e90-f309e05418ff tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:06.580271 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-afcb4cf8-419f-4e4a-9e90-f309e05418ff tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1505 microversion: 2.1 time: 0.250480 May 19 12:20:06.583709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 178/298] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:06 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:06.604055 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-281e7e1c-a68d-425f-8c47-1fdd982e0920 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:06.606932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-281e7e1c-a68d-425f-8c47-1fdd982e0920 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:06.617621 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-281e7e1c-a68d-425f-8c47-1fdd982e0920 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:06.620516 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-281e7e1c-a68d-425f-8c47-1fdd982e0920 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:06.623700 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-281e7e1c-a68d-425f-8c47-1fdd982e0920 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:06.624473 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-281e7e1c-a68d-425f-8c47-1fdd982e0920 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:06.890347 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-281e7e1c-a68d-425f-8c47-1fdd982e0920 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:06.904838 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-281e7e1c-a68d-425f-8c47-1fdd982e0920 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1501 microversion: 2.1 time: 0.309143 May 19 12:20:06.905795 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 121/299] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:06 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1501 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:06.923078 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7cd354e3-1d83-4028-bcfa-ff291415b3c8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41e17dbb-7541-4f94-b09b-f9b0f1c1bf5a"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:20:06.924403 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7cd354e3-1d83-4028-bcfa-ff291415b3c8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:06.936241 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7cd354e3-1d83-4028-bcfa-ff291415b3c8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:06.936935 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7cd354e3-1d83-4028-bcfa-ff291415b3c8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:06.943240 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7cd354e3-1d83-4028-bcfa-ff291415b3c8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:06.943240 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7cd354e3-1d83-4028-bcfa-ff291415b3c8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:06.985016 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-7cd354e3-1d83-4028-bcfa-ff291415b3c8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] HTTP exception thrown: Cannot 'attach_volume' instance b605d4a3-bf90-430f-b2c7-d037b473d29d while it is in vm_state rescued May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7cd354e3-1d83-4028-bcfa-ff291415b3c8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Request method failure captured: May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: POST /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d/os-volume_attachments HTTP/1.1 May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 74 May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjV3ba4_uVlBVIvh_bBreMWZSJM2U80SltnInJem3RpmUyDvutWhoUewS7KziAUbwrvECCf0a_6rYJitU_iO6aJz7Ech1mVe-8aUkQ9TDBlP73buFXKQkkHjg5gljrCoIVxKLRParuGEmqFHmsydgfqVGrlueaFfskHreMvIm9Etqy8 May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: b3d651a605fd4dee95797a7ec3896792 May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1292733612 May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:20:06.987344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:20:06.988662 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:20:06.988662 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1292733612 May 19 12:20:06.988662 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: b3d651a605fd4dee95797a7ec3896792 May 19 12:20:06.988662 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1292733612 May 19 12:20:06.988662 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-ServerRescueNegativeTestJSON-1292733612-project May 19 12:20:06.988662 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:20:06.988662 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:20:06.988662 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: 8e445569dc5641ed962b0ac977850a6c May 19 12:20:06.988662 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1292733612-project May 19 12:20:06.988662 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: May 19 12:20:06.988662 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {"volumeAttachment": {"volumeId": "41e17dbb-7541-4f94-b09b-f9b0f1c1bf5a"}} May 19 12:20:06.988662 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:20:06.989315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Cannot 'attach_volume' instance b605d4a3-bf90-430f-b2c7-d037b473d29d while it is in vm_state rescued May 19 12:20:06.989315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'server_id': 'b605d4a3-bf90-430f-b2c7-d037b473d29d', 'body': {'volumeAttachment': {'volumeId': '41e17dbb-7541-4f94-b09b-f9b0f1c1bf5a'}}} May 19 12:20:06.989315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:20:06.989315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:20:06.989315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 12:20:06.989315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 12:20:06.989315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 12:20:06.989315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 12:20:06.989315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 12:20:06.989315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 12:20:06.989315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b605d4a3-bf90-430f-b2c7-d037b473d29d in vm_state rescued. Cannot attach_volume while the instance is in this state. May 19 12:20:06.989315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:20:06.989315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:20:06.989315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:20:06.989315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:20:06.989315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:20:06.989315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:20:06.989315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:20:06.989315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:20:06.990380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:20:06.990380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:20:06.990380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 12:20:06.990380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:20:06.990380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 12:20:06.990380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:20:06.990380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 12:20:06.990380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:20:06.990380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 19 12:20:06.990380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 12:20:06.990380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 12:20:06.990380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 12:20:06.990380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b605d4a3-bf90-430f-b2c7-d037b473d29d while it is in vm_state rescued May 19 12:20:06.990380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:20:06.990380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:20:06.990380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:20:06.990380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:20:06.990380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:20:06.990380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:20:06.991472 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:20:06.991472 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:20:06.991472 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b605d4a3-bf90-430f-b2c7-d037b473d29d while it is in vm_state rescued May 19 12:20:06.991472 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:20:06.995302 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7cd354e3-1d83-4028-bcfa-ff291415b3c8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Returning 409 to user: Cannot 'attach_volume' instance b605d4a3-bf90-430f-b2c7-d037b473d29d while it is in vm_state rescued {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:20:06.996446 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7cd354e3-1d83-4028-bcfa-ff291415b3c8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "POST /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.077789 May 19 12:20:06.997450 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 179/300] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 19 12:20:06 2022] POST /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d/os-volume_attachments => generated 152 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 12:20:07.009490 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f60a893e-ae6a-4cc4-95d9-ff9fb167e023 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:20:07.010134 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f60a893e-ae6a-4cc4-95d9-ff9fb167e023 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:07.017376 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f60a893e-ae6a-4cc4-95d9-ff9fb167e023 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:07.017925 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f60a893e-ae6a-4cc4-95d9-ff9fb167e023 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:07.018923 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f60a893e-ae6a-4cc4-95d9-ff9fb167e023 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:07.019362 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f60a893e-ae6a-4cc4-95d9-ff9fb167e023 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:07.055229 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:07.372672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f60a893e-ae6a-4cc4-95d9-ff9fb167e023 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "POST /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d/action" status: 202 len: 0 microversion: 2.1 time: 0.370471 May 19 12:20:07.373266 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 122/301] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 19 12:20:07 2022] POST /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:20:07.385724 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-04e39be1-b934-4041-92eb-9b37b27aff88 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:07.386358 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-04e39be1-b934-4041-92eb-9b37b27aff88 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:07.393652 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-04e39be1-b934-4041-92eb-9b37b27aff88 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:07.394220 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-04e39be1-b934-4041-92eb-9b37b27aff88 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:07.395828 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-04e39be1-b934-4041-92eb-9b37b27aff88 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:07.395828 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-04e39be1-b934-4041-92eb-9b37b27aff88 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:07.441089 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e7c4161d-e0a3-4b04-a209-f0f848e579d2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Action: 'create', calling method: .version_select at 0x7f3b9dab6160>, body: {"keypair": {"name": "tempest-keypair-202723125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWte1bWFtXw/FK5cxaA3SgaYQxYf58xhBZpJOjlNnSj8fmdwynB9YJgMCUXWIAvHA85MLFcE1LE/gNyHD3WCi8YAD+BoL+dwiUp5T/gXHjg3XOn3UmK5kxKnufnmjIAnA=="}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:20:07.457543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-e7c4161d-e0a3-4b04-a209-f0f848e579d2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Getting quotas for project 1952e5f71bb245de912a1249fd7f6167. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:20:07.462474 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-e7c4161d-e0a3-4b04-a209-f0f848e579d2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Getting quotas for user 3cdc4cc4d83b4495aa44de70147a001c and project 1952e5f71bb245de912a1249fd7f6167. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:20:07.574715 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e7c4161d-e0a3-4b04-a209-f0f848e579d2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.353798 May 19 12:20:07.575666 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 180/302] 10.222.0.23 () {62 vars in 1199 bytes} [Thu May 19 12:20:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 355 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 19 12:20:07.604416 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fcbe3fe3-5432-463e-94d3-bc9592882f78 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:07.605302 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-fcbe3fe3-5432-463e-94d3-bc9592882f78 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:07.612769 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-04e39be1-b934-4041-92eb-9b37b27aff88 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:07.620378 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fcbe3fe3-5432-463e-94d3-bc9592882f78 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:07.623454 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fcbe3fe3-5432-463e-94d3-bc9592882f78 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:07.624692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fcbe3fe3-5432-463e-94d3-bc9592882f78 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:07.625309 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fcbe3fe3-5432-463e-94d3-bc9592882f78 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:07.626949 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-04e39be1-b934-4041-92eb-9b37b27aff88 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1509 microversion: 2.1 time: 0.247912 May 19 12:20:07.628071 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 123/303] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:07 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:20:07.713609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fcbe3fe3-5432-463e-94d3-bc9592882f78 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:07.722454 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fcbe3fe3-5432-463e-94d3-bc9592882f78 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1463 microversion: 2.1 time: 0.126000 May 19 12:20:07.723323 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 181/304] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:07 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1463 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:20:07.980406 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-3899b332-e2d9-4ab1-ad27-ff71ea57db84 req-2e53e2bb-5586-44ce-a519-b635f1154bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c7b346-edf5-4d57-ba2f-2530abe18632", "name": "network-vif-deleted", "tag": "01ac3c6f-da80-4d77-80a9-e98853b9cebf"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:20:07.991231 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-3899b332-e2d9-4ab1-ad27-ff71ea57db84 req-2e53e2bb-5586-44ce-a519-b635f1154bc7 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:07.992225 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-3899b332-e2d9-4ab1-ad27-ff71ea57db84 req-2e53e2bb-5586-44ce-a519-b635f1154bc7 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:08.004069 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-3899b332-e2d9-4ab1-ad27-ff71ea57db84 req-2e53e2bb-5586-44ce-a519-b635f1154bc7 service nova] Creating event network-vif-deleted:01ac3c6f-da80-4d77-80a9-e98853b9cebf for instance 20c7b346-edf5-4d57-ba2f-2530abe18632 on hv-cinder-80475 May 19 12:20:08.011533 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-3899b332-e2d9-4ab1-ad27-ff71ea57db84 req-2e53e2bb-5586-44ce-a519-b635f1154bc7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036270 May 19 12:20:08.012345 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 124/305] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:20:08.644357 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8c69669e-014b-4043-85a9-ddc3d5c0bca8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:08.645145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8c69669e-014b-4043-85a9-ddc3d5c0bca8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:08.652750 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8c69669e-014b-4043-85a9-ddc3d5c0bca8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:08.653199 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8c69669e-014b-4043-85a9-ddc3d5c0bca8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:08.653963 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8c69669e-014b-4043-85a9-ddc3d5c0bca8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:08.654491 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8c69669e-014b-4043-85a9-ddc3d5c0bca8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:08.742041 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a1f48c4b-26a0-4521-890c-58fd68b65ec6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:08.744430 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a1f48c4b-26a0-4521-890c-58fd68b65ec6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:08.753681 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a1f48c4b-26a0-4521-890c-58fd68b65ec6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:08.762811 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a1f48c4b-26a0-4521-890c-58fd68b65ec6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:08.762811 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a1f48c4b-26a0-4521-890c-58fd68b65ec6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:08.762811 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a1f48c4b-26a0-4521-890c-58fd68b65ec6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:08.850775 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a1f48c4b-26a0-4521-890c-58fd68b65ec6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:08.875083 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a1f48c4b-26a0-4521-890c-58fd68b65ec6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1463 microversion: 2.1 time: 0.138109 May 19 12:20:08.876956 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 125/306] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:08 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1463 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:20:08.893739 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8c69669e-014b-4043-85a9-ddc3d5c0bca8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:08.903726 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8c69669e-014b-4043-85a9-ddc3d5c0bca8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1509 microversion: 2.1 time: 0.263324 May 19 12:20:08.904976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 182/307] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:08 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1509 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:09.904479 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-371d66d9-6a67-4ca8-bbed-79d66cd3085e tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:09.905611 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-371d66d9-6a67-4ca8-bbed-79d66cd3085e tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:09.922237 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8c12c4fb-2b59-4cba-9379-b7e3a3812792 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:09.923656 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8c12c4fb-2b59-4cba-9379-b7e3a3812792 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:09.931055 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-371d66d9-6a67-4ca8-bbed-79d66cd3085e tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:09.931245 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-371d66d9-6a67-4ca8-bbed-79d66cd3085e tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:09.937778 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-371d66d9-6a67-4ca8-bbed-79d66cd3085e tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:09.937974 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8c12c4fb-2b59-4cba-9379-b7e3a3812792 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:09.938322 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8c12c4fb-2b59-4cba-9379-b7e3a3812792 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:09.939382 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8c12c4fb-2b59-4cba-9379-b7e3a3812792 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:09.939647 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-371d66d9-6a67-4ca8-bbed-79d66cd3085e tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:09.940846 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8c12c4fb-2b59-4cba-9379-b7e3a3812792 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:10.047568 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-371d66d9-6a67-4ca8-bbed-79d66cd3085e tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:10.069407 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-371d66d9-6a67-4ca8-bbed-79d66cd3085e tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1463 microversion: 2.1 time: 0.175305 May 19 12:20:10.071822 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 126/308] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:09 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1463 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:10.156159 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8c12c4fb-2b59-4cba-9379-b7e3a3812792 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:10.168056 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8c12c4fb-2b59-4cba-9379-b7e3a3812792 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1509 microversion: 2.1 time: 0.249521 May 19 12:20:10.168178 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 183/309] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:09 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:10.333073 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-40a2652a-a2e8-4327-b8a8-0a76fb24e83e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-729704011", "imageRef": "962252c6-9c2c-4b81-bdb7-f6d317bada3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fae2a519-b2c0-40c8-b8e9-67be2915545e"}], "security_groups": [{"name": "tempest-securitygroup--130350072"}], "key_name": "tempest-keypair-202723125", "user_data": "}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:20:10.441036 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.network.neutron [None req-40a2652a-a2e8-4327-b8a8-0a76fb24e83e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] validate_networks() for [('fae2a519-b2c0-40c8-b8e9-67be2915545e', None, None, None, None, None)] {{(pid=117964) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:20:10.847659 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-40a2652a-a2e8-4327-b8a8-0a76fb24e83e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Flavor limits 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:20:10.848474 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-40a2652a-a2e8-4327-b8a8-0a76fb24e83e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Image limits 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:20:10.848952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-40a2652a-a2e8-4327-b8a8-0a76fb24e83e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Flavor pref 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:20:10.851231 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-40a2652a-a2e8-4327-b8a8-0a76fb24e83e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Image pref 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:20:10.851231 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-40a2652a-a2e8-4327-b8a8-0a76fb24e83e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:20:10.860804 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-40a2652a-a2e8-4327-b8a8-0a76fb24e83e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:10.861373 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-40a2652a-a2e8-4327-b8a8-0a76fb24e83e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:10.862208 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-40a2652a-a2e8-4327-b8a8-0a76fb24e83e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:10.862846 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-40a2652a-a2e8-4327-b8a8-0a76fb24e83e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:10.881441 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-40a2652a-a2e8-4327-b8a8-0a76fb24e83e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Getting quotas for project 1952e5f71bb245de912a1249fd7f6167. Resources: {'instances', 'ram', 'cores'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:20:10.886273 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-40a2652a-a2e8-4327-b8a8-0a76fb24e83e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Getting quotas for user 3cdc4cc4d83b4495aa44de70147a001c and project 1952e5f71bb245de912a1249fd7f6167. Resources: {'instances', 'ram', 'cores'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:20:10.899471 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-40a2652a-a2e8-4327-b8a8-0a76fb24e83e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Going to run 1 instances... {{(pid=117964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:20:10.901948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-40a2652a-a2e8-4327-b8a8-0a76fb24e83e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962252c6-9c2c-4b81-bdb7-f6d317bada3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:20:11.083167 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-40a2652a-a2e8-4327-b8a8-0a76fb24e83e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.754323 May 19 12:20:11.084014 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 127/310] 10.222.0.23 () {62 vars in 1187 bytes} [Thu May 19 12:20:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 12:20:11.093675 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2e8941fa-4a3d-4263-a7dd-18b3b201f99a tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:11.094871 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2e8941fa-4a3d-4263-a7dd-18b3b201f99a tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:11.098463 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-1d33ea6b-40e9-4d32-b4ea-12a787bacd2c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:11.099272 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-1d33ea6b-40e9-4d32-b4ea-12a787bacd2c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:11.104018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2e8941fa-4a3d-4263-a7dd-18b3b201f99a tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:11.104018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2e8941fa-4a3d-4263-a7dd-18b3b201f99a tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:11.104798 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2e8941fa-4a3d-4263-a7dd-18b3b201f99a tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:11.105646 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2e8941fa-4a3d-4263-a7dd-18b3b201f99a tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:11.175883 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-1d33ea6b-40e9-4d32-b4ea-12a787bacd2c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:11.185935 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-1d33ea6b-40e9-4d32-b4ea-12a787bacd2c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:11.187668 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-1d33ea6b-40e9-4d32-b4ea-12a787bacd2c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:11.188812 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-1d33ea6b-40e9-4d32-b4ea-12a787bacd2c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1280 microversion: 2.20 time: 0.094173 May 19 12:20:11.189509 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 128/311] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:20:11 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:20:11.195710 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b6b755d4-bd45-43da-9a4f-70cfb4e7430e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:11.196357 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-b6b755d4-bd45-43da-9a4f-70cfb4e7430e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:11.204700 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b6b755d4-bd45-43da-9a4f-70cfb4e7430e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:11.205354 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b6b755d4-bd45-43da-9a4f-70cfb4e7430e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:11.206143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b6b755d4-bd45-43da-9a4f-70cfb4e7430e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:11.206258 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2e8941fa-4a3d-4263-a7dd-18b3b201f99a tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:11.206578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b6b755d4-bd45-43da-9a4f-70cfb4e7430e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:11.216112 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2e8941fa-4a3d-4263-a7dd-18b3b201f99a tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1463 microversion: 2.1 time: 0.131544 May 19 12:20:11.216690 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 184/312] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:11 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1463 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:11.351318 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b6b755d4-bd45-43da-9a4f-70cfb4e7430e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:11.363291 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b6b755d4-bd45-43da-9a4f-70cfb4e7430e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1509 microversion: 2.1 time: 0.172505 May 19 12:20:11.373776 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 129/313] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:11 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1509 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:12.212679 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1d409c79-7f27-476d-b646-0a991e4c9b2c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:12.213353 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1d409c79-7f27-476d-b646-0a991e4c9b2c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:12.219990 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1d409c79-7f27-476d-b646-0a991e4c9b2c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:12.220443 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1d409c79-7f27-476d-b646-0a991e4c9b2c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:12.221214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1d409c79-7f27-476d-b646-0a991e4c9b2c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:12.221649 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1d409c79-7f27-476d-b646-0a991e4c9b2c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:12.234838 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-211a5250-bf11-4cd1-bddd-3708b0deaadc tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:12.236051 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-211a5250-bf11-4cd1-bddd-3708b0deaadc tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:12.244725 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-211a5250-bf11-4cd1-bddd-3708b0deaadc tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:12.245202 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-211a5250-bf11-4cd1-bddd-3708b0deaadc tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:12.246305 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-211a5250-bf11-4cd1-bddd-3708b0deaadc tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:12.246752 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-211a5250-bf11-4cd1-bddd-3708b0deaadc tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:12.278556 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:12.282285 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-211a5250-bf11-4cd1-bddd-3708b0deaadc tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:12.282731 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-211a5250-bf11-4cd1-bddd-3708b0deaadc tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:12.283191 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.objects.instance [None req-211a5250-bf11-4cd1-bddd-3708b0deaadc tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lazy-loading 'fault' on Instance uuid 20c7b346-edf5-4d57-ba2f-2530abe18632 {{(pid=117964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:20:12.289877 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1d409c79-7f27-476d-b646-0a991e4c9b2c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:12.298618 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1d409c79-7f27-476d-b646-0a991e4c9b2c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:12.300281 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1d409c79-7f27-476d-b646-0a991e4c9b2c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:12.312367 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1d409c79-7f27-476d-b646-0a991e4c9b2c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1284 microversion: 2.20 time: 0.096841 May 19 12:20:12.312367 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 185/314] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:20:12 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:20:12.333042 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-211a5250-bf11-4cd1-bddd-3708b0deaadc tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:12.341277 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-211a5250-bf11-4cd1-bddd-3708b0deaadc tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 200 len: 1304 microversion: 2.1 time: 0.110366 May 19 12:20:12.341847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 130/315] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:12 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:20:12.381154 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e415c667-8c91-4c3f-bb6f-358e3c135b47 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:12.381817 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e415c667-8c91-4c3f-bb6f-358e3c135b47 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:12.388125 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e415c667-8c91-4c3f-bb6f-358e3c135b47 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:12.388692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e415c667-8c91-4c3f-bb6f-358e3c135b47 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:12.389466 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e415c667-8c91-4c3f-bb6f-358e3c135b47 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:12.389984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e415c667-8c91-4c3f-bb6f-358e3c135b47 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:12.529852 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e415c667-8c91-4c3f-bb6f-358e3c135b47 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:12.537324 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e415c667-8c91-4c3f-bb6f-358e3c135b47 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1509 microversion: 2.1 time: 0.160198 May 19 12:20:12.537882 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 186/316] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:12 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:13.319010 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9806c5d4-45bc-49be-ae15-91570f9c08f2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:13.319613 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9806c5d4-45bc-49be-ae15-91570f9c08f2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:13.329829 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9806c5d4-45bc-49be-ae15-91570f9c08f2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:13.330273 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9806c5d4-45bc-49be-ae15-91570f9c08f2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:13.331080 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9806c5d4-45bc-49be-ae15-91570f9c08f2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:13.331660 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9806c5d4-45bc-49be-ae15-91570f9c08f2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:13.360192 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8aaffd4f-a71c-497e-b7a8-342b34ba6035 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:13.360811 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8aaffd4f-a71c-497e-b7a8-342b34ba6035 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: 20c7b346-edf5-4d57-ba2f-2530abe18632] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:13.367586 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8aaffd4f-a71c-497e-b7a8-342b34ba6035 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:13.368084 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8aaffd4f-a71c-497e-b7a8-342b34ba6035 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:13.368864 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8aaffd4f-a71c-497e-b7a8-342b34ba6035 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:13.369403 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8aaffd4f-a71c-497e-b7a8-342b34ba6035 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:13.384209 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-8aaffd4f-a71c-497e-b7a8-342b34ba6035 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] HTTP exception thrown: Instance 20c7b346-edf5-4d57-ba2f-2530abe18632 could not be found. May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8aaffd4f-a71c-497e-b7a8-342b34ba6035 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Request method failure captured: May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 HTTP/1.1 May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjXW0F-KkSpZSH4tgBT4LRp5ZA96iVp5BF0nCu5OpwWAQ3I3EXglZMfWy1HaO7bjSAVK8D5_s-CectvV-R6RTrjhc2DTDs9btGI-_H9LIkN1E8JXKhE-AHEXlGA0tovIAxk4KXEDF0Rq_TsXp_cTGqM-uvAFaHSs66voEuYmCDEvKXM May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 79e70c946e5440e39ee1d7cbeb0a4160 May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-VolumesActionsTest-1497151799 May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:20:13.385760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:20:13.387288 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_79e70c946e5440e39ee1d7cbeb0a4160"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79e70c946e5440e39ee1d7cbeb0a4160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/79e70c946e5440e39ee1d7cbeb0a4160"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79e70c946e5440e39ee1d7cbeb0a4160"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:20:13.387288 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-VolumesActionsTest-1497151799 May 19 12:20:13.387288 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 79e70c946e5440e39ee1d7cbeb0a4160 May 19 12:20:13.387288 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-VolumesActionsTest-1497151799 May 19 12:20:13.387288 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-VolumesActionsTest-1497151799-project May 19 12:20:13.387288 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:20:13.387288 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:20:13.387288 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: 858ef1572f064c248592e92625b228f8 May 19 12:20:13.387288 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-VolumesActionsTest-1497151799-project May 19 12:20:13.387288 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:20:13.387288 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance 20c7b346-edf5-4d57-ba2f-2530abe18632 could not be found. May 19 12:20:13.387288 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': '20c7b346-edf5-4d57-ba2f-2530abe18632'} May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c7b346-edf5-4d57-ba2f-2530abe18632 could not be found. May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:20:13.388157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:20:13.389291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:20:13.389291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:20:13.389291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:20:13.389291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:20:13.389291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:20:13.389291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:20:13.389291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:20:13.389291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c7b346-edf5-4d57-ba2f-2530abe18632 could not be found. May 19 12:20:13.389291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:20:13.389291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:20:13.389291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:20:13.389291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:20:13.389291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:20:13.389291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:20:13.389291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:20:13.389291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:20:13.389291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c7b346-edf5-4d57-ba2f-2530abe18632 could not be found. May 19 12:20:13.389291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:20:13.390293 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8aaffd4f-a71c-497e-b7a8-342b34ba6035 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Returning 404 to user: Instance 20c7b346-edf5-4d57-ba2f-2530abe18632 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:20:13.390293 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8aaffd4f-a71c-497e-b7a8-342b34ba6035 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632" status: 404 len: 111 microversion: 2.1 time: 0.030755 May 19 12:20:13.390293 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 187/317] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:13 2022] GET /compute/v2.1/servers/20c7b346-edf5-4d57-ba2f-2530abe18632 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:20:13.397542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9806c5d4-45bc-49be-ae15-91570f9c08f2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:13.406645 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9806c5d4-45bc-49be-ae15-91570f9c08f2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:13.408184 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9806c5d4-45bc-49be-ae15-91570f9c08f2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:13.409340 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9806c5d4-45bc-49be-ae15-91570f9c08f2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1332 microversion: 2.20 time: 0.094717 May 19 12:20:13.410088 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 131/318] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:20:13 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:20:13.497358 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7fcee745-e30e-4ae2-8b2a-a199ae7fa208 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-659808663", "imageRef": "962252c6-9c2c-4b81-bdb7-f6d317bada3b", "flavorRef": "452", "networks": [{"uuid": "8bb85304-d5d6-43de-9b5a-76646e161de6"}]}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:20:13.555116 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a8bc1d85-e2ee-4548-9476-5b31d7c87c68 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:13.555857 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-7fcee745-e30e-4ae2-8b2a-a199ae7fa208 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] validate_networks() for [('8bb85304-d5d6-43de-9b5a-76646e161de6', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:20:13.555953 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a8bc1d85-e2ee-4548-9476-5b31d7c87c68 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:13.563712 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a8bc1d85-e2ee-4548-9476-5b31d7c87c68 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:13.564193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a8bc1d85-e2ee-4548-9476-5b31d7c87c68 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:13.564964 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a8bc1d85-e2ee-4548-9476-5b31d7c87c68 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:13.565532 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a8bc1d85-e2ee-4548-9476-5b31d7c87c68 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:13.763647 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a8bc1d85-e2ee-4548-9476-5b31d7c87c68 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:13.771377 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a8bc1d85-e2ee-4548-9476-5b31d7c87c68 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1509 microversion: 2.1 time: 0.220801 May 19 12:20:13.781410 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 132/319] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:13 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:20:13.993364 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-7fcee745-e30e-4ae2-8b2a-a199ae7fa208 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:20:13.993787 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-7fcee745-e30e-4ae2-8b2a-a199ae7fa208 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:20:13.994258 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-7fcee745-e30e-4ae2-8b2a-a199ae7fa208 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:20:13.994661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-7fcee745-e30e-4ae2-8b2a-a199ae7fa208 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:20:13.995067 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-7fcee745-e30e-4ae2-8b2a-a199ae7fa208 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:20:14.004115 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7fcee745-e30e-4ae2-8b2a-a199ae7fa208 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:14.004558 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7fcee745-e30e-4ae2-8b2a-a199ae7fa208 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:14.005346 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7fcee745-e30e-4ae2-8b2a-a199ae7fa208 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:14.005778 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7fcee745-e30e-4ae2-8b2a-a199ae7fa208 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:14.022527 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-7fcee745-e30e-4ae2-8b2a-a199ae7fa208 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Getting quotas for project 79e70c946e5440e39ee1d7cbeb0a4160. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:20:14.027391 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-7fcee745-e30e-4ae2-8b2a-a199ae7fa208 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Getting quotas for user 858ef1572f064c248592e92625b228f8 and project 79e70c946e5440e39ee1d7cbeb0a4160. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:20:14.040781 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7fcee745-e30e-4ae2-8b2a-a199ae7fa208 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:20:14.044237 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7fcee745-e30e-4ae2-8b2a-a199ae7fa208 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962252c6-9c2c-4b81-bdb7-f6d317bada3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:20:14.432046 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-021ca455-4be6-4a16-bb24-0f1aa1f1ec97 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:14.432660 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-021ca455-4be6-4a16-bb24-0f1aa1f1ec97 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:14.439575 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-021ca455-4be6-4a16-bb24-0f1aa1f1ec97 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:14.440142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-021ca455-4be6-4a16-bb24-0f1aa1f1ec97 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:14.440913 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-021ca455-4be6-4a16-bb24-0f1aa1f1ec97 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:14.441349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-021ca455-4be6-4a16-bb24-0f1aa1f1ec97 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:14.478735 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7fcee745-e30e-4ae2-8b2a-a199ae7fa208 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.987523 May 19 12:20:14.485834 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 188/320] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:20:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:20:14.491257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8c0bc92c-6b11-4297-8bee-ae5bb1e44f09 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:14.492052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8c0bc92c-6b11-4297-8bee-ae5bb1e44f09 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:14.524886 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-021ca455-4be6-4a16-bb24-0f1aa1f1ec97 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:14.533658 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-021ca455-4be6-4a16-bb24-0f1aa1f1ec97 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:14.535260 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-021ca455-4be6-4a16-bb24-0f1aa1f1ec97 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:14.539004 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-021ca455-4be6-4a16-bb24-0f1aa1f1ec97 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1332 microversion: 2.20 time: 0.110864 May 19 12:20:14.540050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 133/321] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:20:14 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1332 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:20:14.583144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8c0bc92c-6b11-4297-8bee-ae5bb1e44f09 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:14.591056 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8c0bc92c-6b11-4297-8bee-ae5bb1e44f09 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1213 microversion: 2.1 time: 0.103627 May 19 12:20:14.592058 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 189/322] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:14 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:14.795389 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9cfc63df-1c3c-4a18-9c84-7fc8f1451220 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:14.796048 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9cfc63df-1c3c-4a18-9c84-7fc8f1451220 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:14.807222 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9cfc63df-1c3c-4a18-9c84-7fc8f1451220 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:14.812552 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9cfc63df-1c3c-4a18-9c84-7fc8f1451220 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:14.815936 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9cfc63df-1c3c-4a18-9c84-7fc8f1451220 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:14.816505 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9cfc63df-1c3c-4a18-9c84-7fc8f1451220 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:15.000896 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9cfc63df-1c3c-4a18-9c84-7fc8f1451220 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:15.012469 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9cfc63df-1c3c-4a18-9c84-7fc8f1451220 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1509 microversion: 2.1 time: 0.225653 May 19 12:20:15.013840 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 134/323] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:14 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:15.557488 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8fae9ea4-7938-42f7-9d41-fae3735f5721 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:15.558110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8fae9ea4-7938-42f7-9d41-fae3735f5721 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:15.565787 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8fae9ea4-7938-42f7-9d41-fae3735f5721 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:15.566667 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8fae9ea4-7938-42f7-9d41-fae3735f5721 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:15.567529 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8fae9ea4-7938-42f7-9d41-fae3735f5721 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:15.568032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8fae9ea4-7938-42f7-9d41-fae3735f5721 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:15.584392 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:15.608964 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c6def67e-4dcb-4242-9273-4885fc59fc10 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:15.609946 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c6def67e-4dcb-4242-9273-4885fc59fc10 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:15.635143 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8fae9ea4-7938-42f7-9d41-fae3735f5721 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:15.643514 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8fae9ea4-7938-42f7-9d41-fae3735f5721 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:15.645392 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8fae9ea4-7938-42f7-9d41-fae3735f5721 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:15.646522 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8fae9ea4-7938-42f7-9d41-fae3735f5721 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1332 microversion: 2.20 time: 0.093284 May 19 12:20:15.647233 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 190/324] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:20:15 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:20:15.666901 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c6def67e-4dcb-4242-9273-4885fc59fc10 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:15.673894 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c6def67e-4dcb-4242-9273-4885fc59fc10 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1213 microversion: 2.1 time: 0.068908 May 19 12:20:15.674559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 135/325] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:15 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:16.033644 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6d376d80-9af3-47f1-bab3-d8b84610b60c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:16.035525 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6d376d80-9af3-47f1-bab3-d8b84610b60c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:16.046284 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6d376d80-9af3-47f1-bab3-d8b84610b60c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:16.047006 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6d376d80-9af3-47f1-bab3-d8b84610b60c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:16.048493 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6d376d80-9af3-47f1-bab3-d8b84610b60c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:16.049345 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6d376d80-9af3-47f1-bab3-d8b84610b60c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:16.195797 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6d376d80-9af3-47f1-bab3-d8b84610b60c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:16.203950 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6d376d80-9af3-47f1-bab3-d8b84610b60c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1515 microversion: 2.1 time: 0.176969 May 19 12:20:16.204536 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 191/326] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:16 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:20:16.666963 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-8d8462f8-f575-42d2-a9dd-5d915a4d1272 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:16.667847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-8d8462f8-f575-42d2-a9dd-5d915a4d1272 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:16.677043 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8d8462f8-f575-42d2-a9dd-5d915a4d1272 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:16.677654 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8d8462f8-f575-42d2-a9dd-5d915a4d1272 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:16.678483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8d8462f8-f575-42d2-a9dd-5d915a4d1272 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:16.678925 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8d8462f8-f575-42d2-a9dd-5d915a4d1272 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:16.692958 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-49b19594-5d14-4a57-a919-5eed904ae5e5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:16.693684 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-49b19594-5d14-4a57-a919-5eed904ae5e5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:16.704113 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-49b19594-5d14-4a57-a919-5eed904ae5e5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:16.711463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-49b19594-5d14-4a57-a919-5eed904ae5e5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:16.711463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-49b19594-5d14-4a57-a919-5eed904ae5e5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:16.711463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-49b19594-5d14-4a57-a919-5eed904ae5e5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:16.754769 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-8d8462f8-f575-42d2-a9dd-5d915a4d1272 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:16.769921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-8d8462f8-f575-42d2-a9dd-5d915a4d1272 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:16.772071 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-8d8462f8-f575-42d2-a9dd-5d915a4d1272 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:16.775493 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-8d8462f8-f575-42d2-a9dd-5d915a4d1272 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1338 microversion: 2.20 time: 0.113100 May 19 12:20:16.799957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 136/327] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:20:16 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1338 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:20:16.800349 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-49b19594-5d14-4a57-a919-5eed904ae5e5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:16.807643 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-49b19594-5d14-4a57-a919-5eed904ae5e5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1209 microversion: 2.1 time: 0.120437 May 19 12:20:16.808299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 192/328] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:16 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1209 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:17.814608 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-721935fa-c4de-49b1-975f-ebc93d45ad49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:17.815752 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-721935fa-c4de-49b1-975f-ebc93d45ad49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:17.822145 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-721935fa-c4de-49b1-975f-ebc93d45ad49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:17.822696 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-721935fa-c4de-49b1-975f-ebc93d45ad49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:17.823597 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-721935fa-c4de-49b1-975f-ebc93d45ad49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:17.824169 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-721935fa-c4de-49b1-975f-ebc93d45ad49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:17.826187 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f2f76c41-c999-40db-9035-4bc3ff7ca45b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:17.826949 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f2f76c41-c999-40db-9035-4bc3ff7ca45b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:17.836947 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f2f76c41-c999-40db-9035-4bc3ff7ca45b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:17.841936 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f2f76c41-c999-40db-9035-4bc3ff7ca45b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:17.842825 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f2f76c41-c999-40db-9035-4bc3ff7ca45b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:17.843283 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f2f76c41-c999-40db-9035-4bc3ff7ca45b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:17.984089 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f2f76c41-c999-40db-9035-4bc3ff7ca45b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:17.993320 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f2f76c41-c999-40db-9035-4bc3ff7ca45b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1273 microversion: 2.1 time: 0.170856 May 19 12:20:18.014221 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 193/329] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:17 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:18.074116 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-721935fa-c4de-49b1-975f-ebc93d45ad49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:18.082992 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-721935fa-c4de-49b1-975f-ebc93d45ad49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:18.084558 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-721935fa-c4de-49b1-975f-ebc93d45ad49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:18.086271 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-721935fa-c4de-49b1-975f-ebc93d45ad49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1405 microversion: 2.20 time: 0.275811 May 19 12:20:18.086828 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 137/330] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:20:17 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1405 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:20:19.016062 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-2648f83f-6a9c-4af1-b89c-66abf06d5297 req-5bc7ba7a-fc24-4898-8d89-011acaeee372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aedab7fb-ae90-48e1-8745-626d60c88a1a", "tag": "5fc43837-dd78-4f9a-ab74-cfe109a4819d"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:20:19.027375 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e937ccf0-7811-4546-9987-13ad758bdbc6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:19.029284 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e937ccf0-7811-4546-9987-13ad758bdbc6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:19.047671 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-2648f83f-6a9c-4af1-b89c-66abf06d5297 req-5bc7ba7a-fc24-4898-8d89-011acaeee372 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:19.048479 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-2648f83f-6a9c-4af1-b89c-66abf06d5297 req-5bc7ba7a-fc24-4898-8d89-011acaeee372 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:19.073779 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e937ccf0-7811-4546-9987-13ad758bdbc6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:19.074586 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e937ccf0-7811-4546-9987-13ad758bdbc6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:19.079776 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e937ccf0-7811-4546-9987-13ad758bdbc6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:19.080146 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e937ccf0-7811-4546-9987-13ad758bdbc6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:19.098562 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-2648f83f-6a9c-4af1-b89c-66abf06d5297 req-5bc7ba7a-fc24-4898-8d89-011acaeee372 service nova] Creating event network-changed:5fc43837-dd78-4f9a-ab74-cfe109a4819d for instance aedab7fb-ae90-48e1-8745-626d60c88a1a on hv-cinder-80475 May 19 12:20:19.121260 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-2648f83f-6a9c-4af1-b89c-66abf06d5297 req-5bc7ba7a-fc24-4898-8d89-011acaeee372 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110432 May 19 12:20:19.122923 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 138/331] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:20:19.140526 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-592e0539-8a4b-4da3-b2a1-4c8a4e0d2b42 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:19.142075 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-592e0539-8a4b-4da3-b2a1-4c8a4e0d2b42 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:19.173595 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-592e0539-8a4b-4da3-b2a1-4c8a4e0d2b42 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:19.176412 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-592e0539-8a4b-4da3-b2a1-4c8a4e0d2b42 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:19.182892 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-592e0539-8a4b-4da3-b2a1-4c8a4e0d2b42 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:19.184079 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-592e0539-8a4b-4da3-b2a1-4c8a4e0d2b42 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:19.544392 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-592e0539-8a4b-4da3-b2a1-4c8a4e0d2b42 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:19.553312 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e937ccf0-7811-4546-9987-13ad758bdbc6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:19.572240 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-592e0539-8a4b-4da3-b2a1-4c8a4e0d2b42 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:19.572707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e937ccf0-7811-4546-9987-13ad758bdbc6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1313 microversion: 2.1 time: 0.560890 May 19 12:20:19.583525 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 194/332] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:19 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:19.583886 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-592e0539-8a4b-4da3-b2a1-4c8a4e0d2b42 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:19.583886 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-592e0539-8a4b-4da3-b2a1-4c8a4e0d2b42 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1405 microversion: 2.20 time: 0.455352 May 19 12:20:19.583886 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 139/333] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:20:19 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:20:19.584157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b38dc9ad-555c-4001-9306-3ad396bf674c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Action: 'create', calling method: .version_select at 0x7f3b9db5f820>, body: {"keypair": {"name": "tempest-keypair-1933962819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdUG6VSTfb/cpPR5DIYkrw0JxzikxiGJdhlxOTJjFtRbbMhQfI7hcK8MOgPCWkQpQYFcOKUW08SiwL1IdByMHcefzOlsi68x+ko4gym8tao9vcV23kDrUi2nd1nF01rVA=="}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:20:19.593578 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:19.605175 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-b38dc9ad-555c-4001-9306-3ad396bf674c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Getting quotas for project b3d651a605fd4dee95797a7ec3896792. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:20:19.613612 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-b38dc9ad-555c-4001-9306-3ad396bf674c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Getting quotas for user 8e445569dc5641ed962b0ac977850a6c and project b3d651a605fd4dee95797a7ec3896792. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:20:19.734355 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b38dc9ad-555c-4001-9306-3ad396bf674c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.156094 May 19 12:20:19.738940 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 195/334] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 19 12:20:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:20:20.597150 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-15eb15a9-3b0c-47f2-96f5-6125eb739cf0 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:20.599438 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-15eb15a9-3b0c-47f2-96f5-6125eb739cf0 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:20.607057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f76f5430-f863-4a48-9bcf-2698dd6e627e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:20.613086 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f76f5430-f863-4a48-9bcf-2698dd6e627e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:20.620031 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-15eb15a9-3b0c-47f2-96f5-6125eb739cf0 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:20.620828 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-15eb15a9-3b0c-47f2-96f5-6125eb739cf0 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:20.623613 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-15eb15a9-3b0c-47f2-96f5-6125eb739cf0 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:20.628778 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-15eb15a9-3b0c-47f2-96f5-6125eb739cf0 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:20.635984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f76f5430-f863-4a48-9bcf-2698dd6e627e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:20.635984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f76f5430-f863-4a48-9bcf-2698dd6e627e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:20.636450 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f76f5430-f863-4a48-9bcf-2698dd6e627e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:20.637535 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f76f5430-f863-4a48-9bcf-2698dd6e627e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:20.871176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=2 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:21.175144 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-15eb15a9-3b0c-47f2-96f5-6125eb739cf0 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:21.183127 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-15eb15a9-3b0c-47f2-96f5-6125eb739cf0 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1313 microversion: 2.1 time: 0.595529 May 19 12:20:21.183725 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 140/335] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:20 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1313 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:21.188257 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-810b6345-01b0-4685-b8a6-51c220d6e677 req-d40a1167-52c2-474f-ad1d-1ccbee89f289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f144c105-0d18-4e85-91fb-a54fee776414", "tag": "70cddd88-46c7-4b34-aacd-0ae298178ba1"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:20:21.192295 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f76f5430-f863-4a48-9bcf-2698dd6e627e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:21.197527 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-810b6345-01b0-4685-b8a6-51c220d6e677 req-d40a1167-52c2-474f-ad1d-1ccbee89f289 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:21.198182 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-810b6345-01b0-4685-b8a6-51c220d6e677 req-d40a1167-52c2-474f-ad1d-1ccbee89f289 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:21.205439 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f76f5430-f863-4a48-9bcf-2698dd6e627e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:21.207142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f76f5430-f863-4a48-9bcf-2698dd6e627e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:21.208339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f76f5430-f863-4a48-9bcf-2698dd6e627e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1405 microversion: 2.20 time: 0.613219 May 19 12:20:21.209005 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 196/336] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:20:20 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1405 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:20:21.209493 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-810b6345-01b0-4685-b8a6-51c220d6e677 req-d40a1167-52c2-474f-ad1d-1ccbee89f289 service nova] Creating event network-changed:70cddd88-46c7-4b34-aacd-0ae298178ba1 for instance f144c105-0d18-4e85-91fb-a54fee776414 on hv-cinder-80475 May 19 12:20:21.215104 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-810b6345-01b0-4685-b8a6-51c220d6e677 req-d40a1167-52c2-474f-ad1d-1ccbee89f289 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030218 May 19 12:20:21.215737 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 141/337] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:20:22.201279 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f2913b81-9d18-492c-a574-c81902bd334b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:22.201888 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f2913b81-9d18-492c-a574-c81902bd334b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:22.208104 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f2913b81-9d18-492c-a574-c81902bd334b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:22.208561 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f2913b81-9d18-492c-a574-c81902bd334b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:22.209335 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f2913b81-9d18-492c-a574-c81902bd334b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:22.209955 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f2913b81-9d18-492c-a574-c81902bd334b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:22.228394 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-4225537a-ba96-4000-89c3-644f45cca0de tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:22.229098 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-4225537a-ba96-4000-89c3-644f45cca0de tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:22.238577 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4225537a-ba96-4000-89c3-644f45cca0de tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:22.239715 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4225537a-ba96-4000-89c3-644f45cca0de tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:22.240855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4225537a-ba96-4000-89c3-644f45cca0de tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:22.241447 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4225537a-ba96-4000-89c3-644f45cca0de tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:22.265321 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:22.489985 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f2913b81-9d18-492c-a574-c81902bd334b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:22.498675 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f2913b81-9d18-492c-a574-c81902bd334b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1313 microversion: 2.1 time: 0.303023 May 19 12:20:22.499493 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 197/338] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:22 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:22.529910 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-4225537a-ba96-4000-89c3-644f45cca0de tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:22.544584 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-4225537a-ba96-4000-89c3-644f45cca0de tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:22.546482 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-4225537a-ba96-4000-89c3-644f45cca0de tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:22.548236 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-4225537a-ba96-4000-89c3-644f45cca0de tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1405 microversion: 2.20 time: 0.325264 May 19 12:20:22.562038 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 142/339] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:20:22 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1405 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:20:23.517663 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f8f63937-f339-4849-a176-c0e6b41dee45 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:23.518852 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f8f63937-f339-4849-a176-c0e6b41dee45 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:23.528036 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f8f63937-f339-4849-a176-c0e6b41dee45 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:23.528791 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f8f63937-f339-4849-a176-c0e6b41dee45 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:23.530013 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f8f63937-f339-4849-a176-c0e6b41dee45 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:23.530618 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f8f63937-f339-4849-a176-c0e6b41dee45 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:23.578831 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-279d7c18-bbf6-4e8d-8339-ccdefcf3aaca tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:23.579442 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-279d7c18-bbf6-4e8d-8339-ccdefcf3aaca tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:23.587843 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-279d7c18-bbf6-4e8d-8339-ccdefcf3aaca tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:23.588281 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-279d7c18-bbf6-4e8d-8339-ccdefcf3aaca tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:23.589256 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-279d7c18-bbf6-4e8d-8339-ccdefcf3aaca tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:23.589695 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-279d7c18-bbf6-4e8d-8339-ccdefcf3aaca tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:23.738799 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f8f63937-f339-4849-a176-c0e6b41dee45 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:23.747120 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f8f63937-f339-4849-a176-c0e6b41dee45 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1313 microversion: 2.1 time: 0.233627 May 19 12:20:23.748266 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 198/340] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:23 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:23.784296 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-279d7c18-bbf6-4e8d-8339-ccdefcf3aaca tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:23.793697 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-279d7c18-bbf6-4e8d-8339-ccdefcf3aaca tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:23.795305 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-279d7c18-bbf6-4e8d-8339-ccdefcf3aaca tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:23.796420 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-279d7c18-bbf6-4e8d-8339-ccdefcf3aaca tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1405 microversion: 2.20 time: 0.221623 May 19 12:20:23.796980 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 143/341] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:20:23 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:20:23.803758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2caf74d3-6ba9-4635-9804-a5de2938a1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1916823622", "imageRef": "962252c6-9c2c-4b81-bdb7-f6d317bada3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3809f96-195f-4c7b-acab-0be138088685"}], "security_groups": [{"name": "tempest-securitygroup--1267825664"}], "key_name": "tempest-keypair-1933962819", "user_data": "}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:20:23.908500 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-2caf74d3-6ba9-4635-9804-a5de2938a1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] validate_networks() for [('e3809f96-195f-4c7b-acab-0be138088685', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:20:24.014180 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:24.337952 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-2caf74d3-6ba9-4635-9804-a5de2938a1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:20:24.338609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-2caf74d3-6ba9-4635-9804-a5de2938a1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:20:24.339438 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-2caf74d3-6ba9-4635-9804-a5de2938a1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:20:24.340556 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-2caf74d3-6ba9-4635-9804-a5de2938a1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:20:24.341527 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-2caf74d3-6ba9-4635-9804-a5de2938a1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:20:24.354316 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2caf74d3-6ba9-4635-9804-a5de2938a1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:24.355930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2caf74d3-6ba9-4635-9804-a5de2938a1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:24.357523 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2caf74d3-6ba9-4635-9804-a5de2938a1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:24.358138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2caf74d3-6ba9-4635-9804-a5de2938a1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:24.391954 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-2caf74d3-6ba9-4635-9804-a5de2938a1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Getting quotas for project b3d651a605fd4dee95797a7ec3896792. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:20:24.396808 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-2caf74d3-6ba9-4635-9804-a5de2938a1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Getting quotas for user 8e445569dc5641ed962b0ac977850a6c and project b3d651a605fd4dee95797a7ec3896792. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:20:24.416530 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2caf74d3-6ba9-4635-9804-a5de2938a1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:20:24.416530 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2caf74d3-6ba9-4635-9804-a5de2938a1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962252c6-9c2c-4b81-bdb7-f6d317bada3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:20:24.626516 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2caf74d3-6ba9-4635-9804-a5de2938a1f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.827047 May 19 12:20:24.627669 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 199/342] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:20:23 2022] POST /compute/v2.1/servers => generated 409 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 12:20:24.638019 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-64d050a3-7ba4-4171-93a0-bfca1441abec tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:24.638643 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-64d050a3-7ba4-4171-93a0-bfca1441abec tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:24.712185 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-64d050a3-7ba4-4171-93a0-bfca1441abec tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:24.722585 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-64d050a3-7ba4-4171-93a0-bfca1441abec tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1246 microversion: 2.1 time: 0.088445 May 19 12:20:24.723184 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 144/343] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:24 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:24.766021 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e45a139c-0d45-4d31-a7a2-f4e3d3e5057c tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:24.766418 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e45a139c-0d45-4d31-a7a2-f4e3d3e5057c tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:24.777344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e45a139c-0d45-4d31-a7a2-f4e3d3e5057c tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:24.777804 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e45a139c-0d45-4d31-a7a2-f4e3d3e5057c tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:24.778610 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e45a139c-0d45-4d31-a7a2-f4e3d3e5057c tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:24.779070 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e45a139c-0d45-4d31-a7a2-f4e3d3e5057c tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:24.814450 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-43b00054-5268-4d9a-805e-705ebb47e817 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:24.815739 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-43b00054-5268-4d9a-805e-705ebb47e817 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:24.824415 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-43b00054-5268-4d9a-805e-705ebb47e817 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:24.825608 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-43b00054-5268-4d9a-805e-705ebb47e817 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:24.826638 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-43b00054-5268-4d9a-805e-705ebb47e817 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:24.827767 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-43b00054-5268-4d9a-805e-705ebb47e817 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:25.025904 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e45a139c-0d45-4d31-a7a2-f4e3d3e5057c tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:25.036732 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e45a139c-0d45-4d31-a7a2-f4e3d3e5057c tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1313 microversion: 2.1 time: 0.274938 May 19 12:20:25.040908 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 200/344] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:24 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:25.064180 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-43b00054-5268-4d9a-805e-705ebb47e817 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:25.072967 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-43b00054-5268-4d9a-805e-705ebb47e817 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:25.074764 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-43b00054-5268-4d9a-805e-705ebb47e817 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:25.076138 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-43b00054-5268-4d9a-805e-705ebb47e817 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1405 microversion: 2.20 time: 0.265592 May 19 12:20:25.076695 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 145/345] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:20:24 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:20:25.741214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-125286b7-0580-4c00-81aa-879857678f30 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:25.741968 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-125286b7-0580-4c00-81aa-879857678f30 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:25.806501 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-125286b7-0580-4c00-81aa-879857678f30 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:25.816362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-125286b7-0580-4c00-81aa-879857678f30 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1246 microversion: 2.1 time: 0.078791 May 19 12:20:25.817041 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 201/346] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:25 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1246 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:26.055451 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-3478ac04-3c32-4bf5-aafb-a70b02837bb6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:26.056160 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-3478ac04-3c32-4bf5-aafb-a70b02837bb6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:26.062879 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3478ac04-3c32-4bf5-aafb-a70b02837bb6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:26.063334 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3478ac04-3c32-4bf5-aafb-a70b02837bb6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:26.064152 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3478ac04-3c32-4bf5-aafb-a70b02837bb6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:26.064589 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3478ac04-3c32-4bf5-aafb-a70b02837bb6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:26.098604 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d2a9f145-13af-4884-91ef-0bb7357ae924 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:26.099688 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d2a9f145-13af-4884-91ef-0bb7357ae924 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:26.109725 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d2a9f145-13af-4884-91ef-0bb7357ae924 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:26.110402 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d2a9f145-13af-4884-91ef-0bb7357ae924 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:26.111195 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d2a9f145-13af-4884-91ef-0bb7357ae924 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:26.111665 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d2a9f145-13af-4884-91ef-0bb7357ae924 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:26.277088 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-3478ac04-3c32-4bf5-aafb-a70b02837bb6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:26.288235 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-3478ac04-3c32-4bf5-aafb-a70b02837bb6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1313 microversion: 2.1 time: 0.237524 May 19 12:20:26.289657 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 146/347] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:26 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:26.306117 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d2a9f145-13af-4884-91ef-0bb7357ae924 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:26.315014 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d2a9f145-13af-4884-91ef-0bb7357ae924 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:26.316579 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d2a9f145-13af-4884-91ef-0bb7357ae924 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:26.318512 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d2a9f145-13af-4884-91ef-0bb7357ae924 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1405 microversion: 2.20 time: 0.226872 May 19 12:20:26.318512 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 202/348] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:20:26 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:20:26.834792 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-7138deb5-4aa1-420a-aaf4-5c768a541f6d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:26.836094 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-7138deb5-4aa1-420a-aaf4-5c768a541f6d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:26.843121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7138deb5-4aa1-420a-aaf4-5c768a541f6d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:26.843568 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7138deb5-4aa1-420a-aaf4-5c768a541f6d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:26.844385 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7138deb5-4aa1-420a-aaf4-5c768a541f6d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:26.844819 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7138deb5-4aa1-420a-aaf4-5c768a541f6d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:26.913840 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-7138deb5-4aa1-420a-aaf4-5c768a541f6d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:26.922210 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-7138deb5-4aa1-420a-aaf4-5c768a541f6d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1250 microversion: 2.1 time: 0.091340 May 19 12:20:26.922794 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 147/349] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:26 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1250 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:26.933219 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-85dbd94d-4b10-4d89-ad5f-f8a4d0f67f53 req-8339e8cf-8ac0-47ef-a6e0-ac29b27050a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aedab7fb-ae90-48e1-8745-626d60c88a1a", "name": "network-vif-plugged", "status": "completed", "tag": "5fc43837-dd78-4f9a-ab74-cfe109a4819d"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:20:26.942025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-85dbd94d-4b10-4d89-ad5f-f8a4d0f67f53 req-8339e8cf-8ac0-47ef-a6e0-ac29b27050a5 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:26.942967 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-85dbd94d-4b10-4d89-ad5f-f8a4d0f67f53 req-8339e8cf-8ac0-47ef-a6e0-ac29b27050a5 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:26.954973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-85dbd94d-4b10-4d89-ad5f-f8a4d0f67f53 req-8339e8cf-8ac0-47ef-a6e0-ac29b27050a5 service nova] Creating event network-vif-plugged:5fc43837-dd78-4f9a-ab74-cfe109a4819d for instance aedab7fb-ae90-48e1-8745-626d60c88a1a on hv-cinder-80475 May 19 12:20:26.960233 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-85dbd94d-4b10-4d89-ad5f-f8a4d0f67f53 req-8339e8cf-8ac0-47ef-a6e0-ac29b27050a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032249 May 19 12:20:26.961519 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 203/350] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:20:27.307764 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ca9ddac5-20f1-4c52-97be-eab3b5fd4f51 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:27.308957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ca9ddac5-20f1-4c52-97be-eab3b5fd4f51 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:27.316790 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ca9ddac5-20f1-4c52-97be-eab3b5fd4f51 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:27.317274 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ca9ddac5-20f1-4c52-97be-eab3b5fd4f51 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:27.318254 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ca9ddac5-20f1-4c52-97be-eab3b5fd4f51 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:27.318705 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ca9ddac5-20f1-4c52-97be-eab3b5fd4f51 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:27.346174 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-af411ee7-1774-4ea0-aabe-ab858494abcf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:27.347719 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-af411ee7-1774-4ea0-aabe-ab858494abcf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:27.359232 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-af411ee7-1774-4ea0-aabe-ab858494abcf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:27.360040 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-af411ee7-1774-4ea0-aabe-ab858494abcf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:27.361408 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-af411ee7-1774-4ea0-aabe-ab858494abcf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:27.362170 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-af411ee7-1774-4ea0-aabe-ab858494abcf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:27.538214 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ca9ddac5-20f1-4c52-97be-eab3b5fd4f51 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:27.548671 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ca9ddac5-20f1-4c52-97be-eab3b5fd4f51 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1313 microversion: 2.1 time: 0.245381 May 19 12:20:27.560004 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 148/351] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:27 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:27.572296 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-af411ee7-1774-4ea0-aabe-ab858494abcf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:27.580795 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-af411ee7-1774-4ea0-aabe-ab858494abcf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:27.582328 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-af411ee7-1774-4ea0-aabe-ab858494abcf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:27.583469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-af411ee7-1774-4ea0-aabe-ab858494abcf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1405 microversion: 2.20 time: 0.248587 May 19 12:20:27.584086 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 204/352] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:20:27 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1405 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:20:27.940068 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-fe786340-749f-4096-981b-469f8b2e4446 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:27.940600 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-fe786340-749f-4096-981b-469f8b2e4446 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:27.947679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fe786340-749f-4096-981b-469f8b2e4446 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:27.948180 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fe786340-749f-4096-981b-469f8b2e4446 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:27.948965 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fe786340-749f-4096-981b-469f8b2e4446 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:27.949408 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fe786340-749f-4096-981b-469f8b2e4446 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:28.011445 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-fe786340-749f-4096-981b-469f8b2e4446 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:28.019357 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-fe786340-749f-4096-981b-469f8b2e4446 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1250 microversion: 2.1 time: 0.083342 May 19 12:20:28.019977 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 149/353] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:27 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1250 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:28.567892 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-cbefb26a-7e66-4fd9-b4db-0590e0560381 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:28.568543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-cbefb26a-7e66-4fd9-b4db-0590e0560381 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:28.575521 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cbefb26a-7e66-4fd9-b4db-0590e0560381 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:28.576013 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cbefb26a-7e66-4fd9-b4db-0590e0560381 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:28.576786 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cbefb26a-7e66-4fd9-b4db-0590e0560381 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:28.577221 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cbefb26a-7e66-4fd9-b4db-0590e0560381 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:28.605301 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-79906f5e-38ed-436e-9e25-efbfcb859849 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:28.606244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-79906f5e-38ed-436e-9e25-efbfcb859849 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:28.624218 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-79906f5e-38ed-436e-9e25-efbfcb859849 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:28.624679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-79906f5e-38ed-436e-9e25-efbfcb859849 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:28.625476 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-79906f5e-38ed-436e-9e25-efbfcb859849 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:28.625919 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-79906f5e-38ed-436e-9e25-efbfcb859849 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:28.803252 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-cbefb26a-7e66-4fd9-b4db-0590e0560381 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:28.813956 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-cbefb26a-7e66-4fd9-b4db-0590e0560381 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1313 microversion: 2.1 time: 0.249738 May 19 12:20:28.815183 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 205/354] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:28 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:28.828351 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-79906f5e-38ed-436e-9e25-efbfcb859849 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:28.838944 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-79906f5e-38ed-436e-9e25-efbfcb859849 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:28.840648 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-79906f5e-38ed-436e-9e25-efbfcb859849 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:28.842020 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-79906f5e-38ed-436e-9e25-efbfcb859849 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1405 microversion: 2.20 time: 0.243478 May 19 12:20:28.842764 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 150/355] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:20:28 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1405 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:20:29.036994 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-74c7fef3-8ec3-41b8-8c7a-f546a48ccf9b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:29.037734 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-74c7fef3-8ec3-41b8-8c7a-f546a48ccf9b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:29.044105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-74c7fef3-8ec3-41b8-8c7a-f546a48ccf9b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:29.044571 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-74c7fef3-8ec3-41b8-8c7a-f546a48ccf9b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:29.045361 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-74c7fef3-8ec3-41b8-8c7a-f546a48ccf9b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:29.045805 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-74c7fef3-8ec3-41b8-8c7a-f546a48ccf9b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:29.109675 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-74c7fef3-8ec3-41b8-8c7a-f546a48ccf9b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:29.118011 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-74c7fef3-8ec3-41b8-8c7a-f546a48ccf9b tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1242 microversion: 2.1 time: 0.084808 May 19 12:20:29.118742 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 206/356] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:29 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:29.831983 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-7d891974-a0c8-475d-ae42-77ba30bae9c6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:29.849286 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-7d891974-a0c8-475d-ae42-77ba30bae9c6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:29.849286 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7d891974-a0c8-475d-ae42-77ba30bae9c6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:29.849286 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7d891974-a0c8-475d-ae42-77ba30bae9c6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:29.849286 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7d891974-a0c8-475d-ae42-77ba30bae9c6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:29.850682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7d891974-a0c8-475d-ae42-77ba30bae9c6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:29.861228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3f21e46e-91a9-4602-a790-9eba116f667a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:29.862035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3f21e46e-91a9-4602-a790-9eba116f667a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:29.871157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3f21e46e-91a9-4602-a790-9eba116f667a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:29.871157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3f21e46e-91a9-4602-a790-9eba116f667a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:29.871157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3f21e46e-91a9-4602-a790-9eba116f667a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:29.873041 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3f21e46e-91a9-4602-a790-9eba116f667a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:30.048114 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-7d891974-a0c8-475d-ae42-77ba30bae9c6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:30.056685 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-7d891974-a0c8-475d-ae42-77ba30bae9c6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1313 microversion: 2.1 time: 0.228766 May 19 12:20:30.060669 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 151/357] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:29 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:30.074478 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3f21e46e-91a9-4602-a790-9eba116f667a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:30.074478 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3f21e46e-91a9-4602-a790-9eba116f667a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:30.074769 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3f21e46e-91a9-4602-a790-9eba116f667a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:30.074873 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3f21e46e-91a9-4602-a790-9eba116f667a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1405 microversion: 2.20 time: 0.217666 May 19 12:20:30.075370 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 207/358] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:20:29 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:20:30.136851 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d8748d6d-23eb-42fe-a13f-77e80fe7b5cb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:30.137359 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d8748d6d-23eb-42fe-a13f-77e80fe7b5cb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:30.144312 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d8748d6d-23eb-42fe-a13f-77e80fe7b5cb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:30.144753 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d8748d6d-23eb-42fe-a13f-77e80fe7b5cb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:30.145557 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d8748d6d-23eb-42fe-a13f-77e80fe7b5cb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:30.145990 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d8748d6d-23eb-42fe-a13f-77e80fe7b5cb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:30.213264 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d8748d6d-23eb-42fe-a13f-77e80fe7b5cb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:30.221426 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d8748d6d-23eb-42fe-a13f-77e80fe7b5cb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1298 microversion: 2.1 time: 0.088989 May 19 12:20:30.222781 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 152/359] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:30 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:31.074772 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-34ba68f5-d16f-46cc-9425-e09623d4f844 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:31.076379 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-34ba68f5-d16f-46cc-9425-e09623d4f844 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:31.083011 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-34ba68f5-d16f-46cc-9425-e09623d4f844 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:31.083527 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-34ba68f5-d16f-46cc-9425-e09623d4f844 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:31.084870 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-34ba68f5-d16f-46cc-9425-e09623d4f844 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:31.085403 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-34ba68f5-d16f-46cc-9425-e09623d4f844 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:31.094256 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-343f3e25-c33f-4abe-910f-1752b54354d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:31.095678 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-343f3e25-c33f-4abe-910f-1752b54354d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:31.104815 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-343f3e25-c33f-4abe-910f-1752b54354d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:31.105527 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-343f3e25-c33f-4abe-910f-1752b54354d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:31.108018 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-343f3e25-c33f-4abe-910f-1752b54354d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:31.108497 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-343f3e25-c33f-4abe-910f-1752b54354d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:31.298512 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-34ba68f5-d16f-46cc-9425-e09623d4f844 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:31.324414 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-34ba68f5-d16f-46cc-9425-e09623d4f844 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1313 microversion: 2.1 time: 0.253735 May 19 12:20:31.329922 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 208/360] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:31 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:31.330453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-343f3e25-c33f-4abe-910f-1752b54354d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:31.337814 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-53539919-416c-41be-8e49-44c1bfc5fd08 req-d9099d36-68b3-401e-898c-f0376a015355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f144c105-0d18-4e85-91fb-a54fee776414", "name": "network-vif-plugged", "status": "completed", "tag": "70cddd88-46c7-4b34-aacd-0ae298178ba1"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:20:31.341152 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-343f3e25-c33f-4abe-910f-1752b54354d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:31.342905 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-343f3e25-c33f-4abe-910f-1752b54354d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:31.344093 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-343f3e25-c33f-4abe-910f-1752b54354d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1405 microversion: 2.20 time: 0.254504 May 19 12:20:31.354849 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 153/361] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:20:31 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1405 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:20:31.354849 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-17d71916-b339-4a6e-a67b-1fc369426c71 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:31.354849 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-17d71916-b339-4a6e-a67b-1fc369426c71 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:31.359736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-17d71916-b339-4a6e-a67b-1fc369426c71 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:31.359736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-17d71916-b339-4a6e-a67b-1fc369426c71 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:31.360187 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-17d71916-b339-4a6e-a67b-1fc369426c71 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:31.360623 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-17d71916-b339-4a6e-a67b-1fc369426c71 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:31.370120 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-53539919-416c-41be-8e49-44c1bfc5fd08 req-d9099d36-68b3-401e-898c-f0376a015355 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:31.370771 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-53539919-416c-41be-8e49-44c1bfc5fd08 req-d9099d36-68b3-401e-898c-f0376a015355 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:31.396960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-53539919-416c-41be-8e49-44c1bfc5fd08 req-d9099d36-68b3-401e-898c-f0376a015355 service nova] Creating event network-vif-plugged:70cddd88-46c7-4b34-aacd-0ae298178ba1 for instance f144c105-0d18-4e85-91fb-a54fee776414 on hv-cinder-80475 May 19 12:20:31.406757 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-53539919-416c-41be-8e49-44c1bfc5fd08 req-d9099d36-68b3-401e-898c-f0376a015355 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073085 May 19 12:20:31.408222 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 209/362] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:20:31.459778 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-17d71916-b339-4a6e-a67b-1fc369426c71 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:31.469916 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-17d71916-b339-4a6e-a67b-1fc369426c71 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1306 microversion: 2.1 time: 0.123785 May 19 12:20:31.480363 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 154/363] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:31 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1306 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:32.351952 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4eddf745-ee7c-4fb4-92cb-eaf1b828809a tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:32.357857 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4eddf745-ee7c-4fb4-92cb-eaf1b828809a tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:32.363396 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-224f43f9-f551-4aae-a95f-fb0a7c4c6c48 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:32.364453 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4eddf745-ee7c-4fb4-92cb-eaf1b828809a tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:32.365102 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-224f43f9-f551-4aae-a95f-fb0a7c4c6c48 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:32.365431 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4eddf745-ee7c-4fb4-92cb-eaf1b828809a tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:32.366678 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4eddf745-ee7c-4fb4-92cb-eaf1b828809a tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:32.368070 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4eddf745-ee7c-4fb4-92cb-eaf1b828809a tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:32.383286 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-224f43f9-f551-4aae-a95f-fb0a7c4c6c48 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:32.383684 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-224f43f9-f551-4aae-a95f-fb0a7c4c6c48 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:32.387021 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-224f43f9-f551-4aae-a95f-fb0a7c4c6c48 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:32.387477 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-224f43f9-f551-4aae-a95f-fb0a7c4c6c48 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:32.620755 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4eddf745-ee7c-4fb4-92cb-eaf1b828809a tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:32.630091 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4eddf745-ee7c-4fb4-92cb-eaf1b828809a tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1313 microversion: 2.1 time: 0.291534 May 19 12:20:32.630796 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 210/364] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:32 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:32.634101 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-224f43f9-f551-4aae-a95f-fb0a7c4c6c48 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:32.641434 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f0e22f14-c45c-4f0a-89e5-c4a7cadedce8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:32.642348 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f0e22f14-c45c-4f0a-89e5-c4a7cadedce8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:32.643849 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-224f43f9-f551-4aae-a95f-fb0a7c4c6c48 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:32.646618 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-224f43f9-f551-4aae-a95f-fb0a7c4c6c48 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:32.648399 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-224f43f9-f551-4aae-a95f-fb0a7c4c6c48 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1597 microversion: 2.20 time: 0.289028 May 19 12:20:32.649490 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 155/365] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:20:32 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1597 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:20:32.650386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f0e22f14-c45c-4f0a-89e5-c4a7cadedce8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:32.658076 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f0e22f14-c45c-4f0a-89e5-c4a7cadedce8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:32.658076 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f0e22f14-c45c-4f0a-89e5-c4a7cadedce8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:32.658076 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f0e22f14-c45c-4f0a-89e5-c4a7cadedce8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:32.673963 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5910adaf-4614-43f1-bea1-ee6a5a3344a4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:32.674625 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5910adaf-4614-43f1-bea1-ee6a5a3344a4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:32.679882 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:32.682623 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5910adaf-4614-43f1-bea1-ee6a5a3344a4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:32.683073 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5910adaf-4614-43f1-bea1-ee6a5a3344a4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:32.684098 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5910adaf-4614-43f1-bea1-ee6a5a3344a4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:32.684543 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5910adaf-4614-43f1-bea1-ee6a5a3344a4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:32.748180 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f0e22f14-c45c-4f0a-89e5-c4a7cadedce8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:32.756718 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f0e22f14-c45c-4f0a-89e5-c4a7cadedce8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1304 microversion: 2.1 time: 0.124508 May 19 12:20:32.765970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 211/366] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:32 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:32.797359 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5910adaf-4614-43f1-bea1-ee6a5a3344a4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.127060 May 19 12:20:32.798050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 156/367] 10.222.0.23 () {60 vars in 1315 bytes} [Thu May 19 12:20:32 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 12:20:33.651725 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f4d63da0-4ed4-4609-8d40-cac50b84f717 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:33.652613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f4d63da0-4ed4-4609-8d40-cac50b84f717 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:33.659659 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4d63da0-4ed4-4609-8d40-cac50b84f717 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:33.660402 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4d63da0-4ed4-4609-8d40-cac50b84f717 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:33.661473 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4d63da0-4ed4-4609-8d40-cac50b84f717 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:33.662002 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4d63da0-4ed4-4609-8d40-cac50b84f717 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:33.784354 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f62dacd2-2d86-413c-82d4-1fb4027a6440 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:33.785915 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f62dacd2-2d86-413c-82d4-1fb4027a6440 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:33.793355 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f62dacd2-2d86-413c-82d4-1fb4027a6440 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:33.794157 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f62dacd2-2d86-413c-82d4-1fb4027a6440 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:33.795495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f62dacd2-2d86-413c-82d4-1fb4027a6440 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:33.796189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f62dacd2-2d86-413c-82d4-1fb4027a6440 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:34.156622 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f62dacd2-2d86-413c-82d4-1fb4027a6440 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:34.157978 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f4d63da0-4ed4-4609-8d40-cac50b84f717 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:34.167447 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f62dacd2-2d86-413c-82d4-1fb4027a6440 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1372 microversion: 2.1 time: 0.388101 May 19 12:20:34.172943 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f4d63da0-4ed4-4609-8d40-cac50b84f717 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1313 microversion: 2.1 time: 0.526883 May 19 12:20:34.177652 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 157/368] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:33 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1372 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:20:34.181460 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 212/369] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:33 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1313 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:34.185567 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-01c76e8a-6619-4788-a6d0-79246fa34747 req-a66bfe51-9b5b-4561-b73f-494a2a79b9dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caffcacb-8fb4-412e-ae78-67570b491068", "tag": "413f04d8-4ef0-4bef-8ee6-725aaa428db9"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:20:34.194382 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-01c76e8a-6619-4788-a6d0-79246fa34747 req-a66bfe51-9b5b-4561-b73f-494a2a79b9dd service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:34.195631 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-01c76e8a-6619-4788-a6d0-79246fa34747 req-a66bfe51-9b5b-4561-b73f-494a2a79b9dd service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:34.208710 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-01c76e8a-6619-4788-a6d0-79246fa34747 req-a66bfe51-9b5b-4561-b73f-494a2a79b9dd service nova] Creating event network-changed:413f04d8-4ef0-4bef-8ee6-725aaa428db9 for instance caffcacb-8fb4-412e-ae78-67570b491068 on hv-cinder-80475 May 19 12:20:34.214212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-01c76e8a-6619-4788-a6d0-79246fa34747 req-a66bfe51-9b5b-4561-b73f-494a2a79b9dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034959 May 19 12:20:34.215092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 158/370] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:20:34.424951 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-dbffc97c-513b-4908-add9-faf57577335d req-2309a185-531c-46ed-a6c8-e2ad2cc3f5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aedab7fb-ae90-48e1-8745-626d60c88a1a", "tag": "5fc43837-dd78-4f9a-ab74-cfe109a4819d"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:20:34.434227 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-dbffc97c-513b-4908-add9-faf57577335d req-2309a185-531c-46ed-a6c8-e2ad2cc3f5e4 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:34.443368 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-dbffc97c-513b-4908-add9-faf57577335d req-2309a185-531c-46ed-a6c8-e2ad2cc3f5e4 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:34.448198 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-dbffc97c-513b-4908-add9-faf57577335d req-2309a185-531c-46ed-a6c8-e2ad2cc3f5e4 service nova] Creating event network-changed:5fc43837-dd78-4f9a-ab74-cfe109a4819d for instance aedab7fb-ae90-48e1-8745-626d60c88a1a on hv-cinder-80475 May 19 12:20:34.453997 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-dbffc97c-513b-4908-add9-faf57577335d req-2309a185-531c-46ed-a6c8-e2ad2cc3f5e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032753 May 19 12:20:34.455242 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 213/371] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:20:35.184663 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=12 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:35.193345 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-374e64e4-05d2-4486-84fc-84ae8ce0e882 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:35.197538 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-374e64e4-05d2-4486-84fc-84ae8ce0e882 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:35.197745 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-90253f99-eff6-4763-9e90-db65b87d05ec tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:35.197745 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-90253f99-eff6-4763-9e90-db65b87d05ec tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:35.204833 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-374e64e4-05d2-4486-84fc-84ae8ce0e882 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:35.205444 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-374e64e4-05d2-4486-84fc-84ae8ce0e882 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:35.206500 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-374e64e4-05d2-4486-84fc-84ae8ce0e882 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:35.206998 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-374e64e4-05d2-4486-84fc-84ae8ce0e882 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:35.210986 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-90253f99-eff6-4763-9e90-db65b87d05ec tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:35.211549 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-90253f99-eff6-4763-9e90-db65b87d05ec tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:35.213674 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-90253f99-eff6-4763-9e90-db65b87d05ec tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:35.213674 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-90253f99-eff6-4763-9e90-db65b87d05ec tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:35.430699 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-374e64e4-05d2-4486-84fc-84ae8ce0e882 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:35.438059 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-90253f99-eff6-4763-9e90-db65b87d05ec tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:35.448798 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-90253f99-eff6-4763-9e90-db65b87d05ec tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1498 microversion: 2.1 time: 0.261088 May 19 12:20:35.449409 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 214/372] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:35 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1498 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:35.453471 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-374e64e4-05d2-4486-84fc-84ae8ce0e882 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1372 microversion: 2.1 time: 0.270307 May 19 12:20:35.454077 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 159/373] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:35 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1372 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:36.470756 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9fdc1f82-7375-4ef9-9cbd-4a80314f7720 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:36.471315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9fdc1f82-7375-4ef9-9cbd-4a80314f7720 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:36.473277 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:36.473935 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=24 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:36.479016 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9fdc1f82-7375-4ef9-9cbd-4a80314f7720 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:36.479467 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9fdc1f82-7375-4ef9-9cbd-4a80314f7720 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:36.480446 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9fdc1f82-7375-4ef9-9cbd-4a80314f7720 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:36.481138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9fdc1f82-7375-4ef9-9cbd-4a80314f7720 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:36.630509 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9fdc1f82-7375-4ef9-9cbd-4a80314f7720 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:36.641173 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9fdc1f82-7375-4ef9-9cbd-4a80314f7720 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1372 microversion: 2.1 time: 0.173221 May 19 12:20:36.641173 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 215/374] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:36 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:36.695926 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-880c0347-7052-4095-99d9-02ce76778758 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:36.696491 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-880c0347-7052-4095-99d9-02ce76778758 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:36.704069 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-880c0347-7052-4095-99d9-02ce76778758 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:36.704656 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-880c0347-7052-4095-99d9-02ce76778758 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:36.705481 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-880c0347-7052-4095-99d9-02ce76778758 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:36.705921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-880c0347-7052-4095-99d9-02ce76778758 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:36.733088 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-880c0347-7052-4095-99d9-02ce76778758 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Going to try to terminate instance {{(pid=117964) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:20:36.747254 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=100 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:37.189108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-880c0347-7052-4095-99d9-02ce76778758 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 204 len: 0 microversion: 2.1 time: 0.497087 May 19 12:20:37.189691 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 160/375] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:20:36 2022] DELETE /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:20:37.198325 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-dbe8ebba-c6a7-481c-a007-fcdd54047728 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:37.203699 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-dbe8ebba-c6a7-481c-a007-fcdd54047728 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:37.205221 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbe8ebba-c6a7-481c-a007-fcdd54047728 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:37.205716 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbe8ebba-c6a7-481c-a007-fcdd54047728 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:37.206493 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbe8ebba-c6a7-481c-a007-fcdd54047728 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:37.206923 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbe8ebba-c6a7-481c-a007-fcdd54047728 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:37.343445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-dbe8ebba-c6a7-481c-a007-fcdd54047728 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:37.351039 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-dbe8ebba-c6a7-481c-a007-fcdd54047728 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1504 microversion: 2.1 time: 0.156985 May 19 12:20:37.353595 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 216/376] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:37 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:37.657702 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ec574b6f-67f4-43ab-a3d6-8c097788bd85 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:37.658403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ec574b6f-67f4-43ab-a3d6-8c097788bd85 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:37.664641 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ec574b6f-67f4-43ab-a3d6-8c097788bd85 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:37.665096 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ec574b6f-67f4-43ab-a3d6-8c097788bd85 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:37.665881 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ec574b6f-67f4-43ab-a3d6-8c097788bd85 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:37.666321 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ec574b6f-67f4-43ab-a3d6-8c097788bd85 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:37.807231 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ec574b6f-67f4-43ab-a3d6-8c097788bd85 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:37.815390 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ec574b6f-67f4-43ab-a3d6-8c097788bd85 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1372 microversion: 2.1 time: 0.161845 May 19 12:20:37.815995 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 161/377] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:37 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:38.370268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b61f802b-6f05-4de0-a7f5-0536c2cf463b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:38.370879 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b61f802b-6f05-4de0-a7f5-0536c2cf463b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:38.378839 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b61f802b-6f05-4de0-a7f5-0536c2cf463b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:38.379281 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b61f802b-6f05-4de0-a7f5-0536c2cf463b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:38.380061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b61f802b-6f05-4de0-a7f5-0536c2cf463b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:38.380493 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b61f802b-6f05-4de0-a7f5-0536c2cf463b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:38.512060 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b61f802b-6f05-4de0-a7f5-0536c2cf463b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:38.519903 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b61f802b-6f05-4de0-a7f5-0536c2cf463b tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1504 microversion: 2.1 time: 0.153487 May 19 12:20:38.520482 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 217/378] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:38 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:38.838187 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-2fc95409-0d11-486c-8887-072270d1688e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:38.846995 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-2fc95409-0d11-486c-8887-072270d1688e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:38.849446 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2fc95409-0d11-486c-8887-072270d1688e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:38.849892 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2fc95409-0d11-486c-8887-072270d1688e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:38.851102 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2fc95409-0d11-486c-8887-072270d1688e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:38.851978 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2fc95409-0d11-486c-8887-072270d1688e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:38.990751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-2fc95409-0d11-486c-8887-072270d1688e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:38.999888 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-2fc95409-0d11-486c-8887-072270d1688e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1372 microversion: 2.1 time: 0.171551 May 19 12:20:39.006692 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 162/379] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:38 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:39.538164 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-672312ec-2740-48f8-8575-bb94c75d131f tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:39.538893 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-672312ec-2740-48f8-8575-bb94c75d131f tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:39.545239 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-672312ec-2740-48f8-8575-bb94c75d131f tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:39.545643 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-672312ec-2740-48f8-8575-bb94c75d131f tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:39.546394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-672312ec-2740-48f8-8575-bb94c75d131f tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:39.546825 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-672312ec-2740-48f8-8575-bb94c75d131f tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:39.700476 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-672312ec-2740-48f8-8575-bb94c75d131f tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:39.708919 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-672312ec-2740-48f8-8575-bb94c75d131f tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1504 microversion: 2.1 time: 0.174685 May 19 12:20:39.715372 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 218/380] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:39 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:40.017937 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5f2a41f3-db6b-48a6-a87f-9241d697a651 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:40.018562 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5f2a41f3-db6b-48a6-a87f-9241d697a651 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:40.026788 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5f2a41f3-db6b-48a6-a87f-9241d697a651 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:40.027249 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5f2a41f3-db6b-48a6-a87f-9241d697a651 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:40.028112 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5f2a41f3-db6b-48a6-a87f-9241d697a651 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:40.028558 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5f2a41f3-db6b-48a6-a87f-9241d697a651 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:40.170147 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5f2a41f3-db6b-48a6-a87f-9241d697a651 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:40.188511 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5f2a41f3-db6b-48a6-a87f-9241d697a651 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1372 microversion: 2.1 time: 0.164209 May 19 12:20:40.189172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 163/381] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:40 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:40.730466 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2de9abdf-3686-463d-800e-b4732eecd3f6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:40.731328 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2de9abdf-3686-463d-800e-b4732eecd3f6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:40.737928 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2de9abdf-3686-463d-800e-b4732eecd3f6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:40.738466 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2de9abdf-3686-463d-800e-b4732eecd3f6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:40.739136 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2de9abdf-3686-463d-800e-b4732eecd3f6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:40.739563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2de9abdf-3686-463d-800e-b4732eecd3f6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:40.908657 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2de9abdf-3686-463d-800e-b4732eecd3f6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:40.920073 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2de9abdf-3686-463d-800e-b4732eecd3f6 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1504 microversion: 2.1 time: 0.191439 May 19 12:20:40.920073 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 219/382] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:40 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:41.206971 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-26990712-39a8-4042-aba4-077787dd5f13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:41.207591 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-26990712-39a8-4042-aba4-077787dd5f13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:41.214689 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-26990712-39a8-4042-aba4-077787dd5f13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:41.215136 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-26990712-39a8-4042-aba4-077787dd5f13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:41.216132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-26990712-39a8-4042-aba4-077787dd5f13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:41.216616 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-26990712-39a8-4042-aba4-077787dd5f13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:41.373345 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-26990712-39a8-4042-aba4-077787dd5f13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:41.381186 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-26990712-39a8-4042-aba4-077787dd5f13 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1372 microversion: 2.1 time: 0.178200 May 19 12:20:41.392271 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 164/383] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:41 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:41.484510 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-6f1070d8-c4d7-475c-b032-64e5eb8f49ec req-516f1237-8cfc-4b14-bf04-4cbfa80c2d8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f144c105-0d18-4e85-91fb-a54fee776414", "name": "network-vif-deleted", "tag": "70cddd88-46c7-4b34-aacd-0ae298178ba1"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:20:41.495206 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-6f1070d8-c4d7-475c-b032-64e5eb8f49ec req-516f1237-8cfc-4b14-bf04-4cbfa80c2d8f service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:41.502775 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-6f1070d8-c4d7-475c-b032-64e5eb8f49ec req-516f1237-8cfc-4b14-bf04-4cbfa80c2d8f service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:41.515568 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-6f1070d8-c4d7-475c-b032-64e5eb8f49ec req-516f1237-8cfc-4b14-bf04-4cbfa80c2d8f service nova] Creating event network-vif-deleted:70cddd88-46c7-4b34-aacd-0ae298178ba1 for instance f144c105-0d18-4e85-91fb-a54fee776414 on hv-cinder-80475 May 19 12:20:41.522326 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-6f1070d8-c4d7-475c-b032-64e5eb8f49ec req-516f1237-8cfc-4b14-bf04-4cbfa80c2d8f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042460 May 19 12:20:41.523779 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 220/384] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:20:41.762248 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-40b13e07-c264-48db-b496-8f3617a9076e req-377dd416-561c-41e1-9de6-84c2a1be1dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caffcacb-8fb4-412e-ae78-67570b491068", "name": "network-vif-plugged", "status": "completed", "tag": "413f04d8-4ef0-4bef-8ee6-725aaa428db9"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:20:41.770822 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-40b13e07-c264-48db-b496-8f3617a9076e req-377dd416-561c-41e1-9de6-84c2a1be1dfd service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:41.775035 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-40b13e07-c264-48db-b496-8f3617a9076e req-377dd416-561c-41e1-9de6-84c2a1be1dfd service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:41.790293 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-40b13e07-c264-48db-b496-8f3617a9076e req-377dd416-561c-41e1-9de6-84c2a1be1dfd service nova] Creating event network-vif-plugged:413f04d8-4ef0-4bef-8ee6-725aaa428db9 for instance caffcacb-8fb4-412e-ae78-67570b491068 on hv-cinder-80475 May 19 12:20:41.796691 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-40b13e07-c264-48db-b496-8f3617a9076e req-377dd416-561c-41e1-9de6-84c2a1be1dfd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043772 May 19 12:20:41.797551 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 165/385] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:20:41.936008 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-dfbbfd36-a709-47e0-af01-a0a55cf955aa tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:41.937298 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-dfbbfd36-a709-47e0-af01-a0a55cf955aa tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:41.944650 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dfbbfd36-a709-47e0-af01-a0a55cf955aa tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:41.946148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dfbbfd36-a709-47e0-af01-a0a55cf955aa tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:41.947178 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dfbbfd36-a709-47e0-af01-a0a55cf955aa tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:41.947610 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dfbbfd36-a709-47e0-af01-a0a55cf955aa tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:42.028141 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-dfbbfd36-a709-47e0-af01-a0a55cf955aa tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:42.031103 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-dfbbfd36-a709-47e0-af01-a0a55cf955aa tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1298 microversion: 2.1 time: 0.099400 May 19 12:20:42.032258 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 221/386] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:41 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1298 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:42.408348 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0ca08a70-957c-4ab5-b9a3-8e77b8d7f276 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:42.409049 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0ca08a70-957c-4ab5-b9a3-8e77b8d7f276 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:42.417559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0ca08a70-957c-4ab5-b9a3-8e77b8d7f276 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:42.418009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0ca08a70-957c-4ab5-b9a3-8e77b8d7f276 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:42.418829 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0ca08a70-957c-4ab5-b9a3-8e77b8d7f276 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:42.419255 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0ca08a70-957c-4ab5-b9a3-8e77b8d7f276 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:42.676141 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-0ca08a70-957c-4ab5-b9a3-8e77b8d7f276 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:42.684943 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0ca08a70-957c-4ab5-b9a3-8e77b8d7f276 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1372 microversion: 2.1 time: 0.282307 May 19 12:20:42.686938 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 166/387] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:42 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1372 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:43.048249 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1406a9f2-53c7-49ca-b91d-75387b1273bb tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:43.048870 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1406a9f2-53c7-49ca-b91d-75387b1273bb tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:43.056437 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1406a9f2-53c7-49ca-b91d-75387b1273bb tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:43.056890 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1406a9f2-53c7-49ca-b91d-75387b1273bb tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:43.057667 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1406a9f2-53c7-49ca-b91d-75387b1273bb tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:43.058103 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1406a9f2-53c7-49ca-b91d-75387b1273bb tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:43.091192 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1406a9f2-53c7-49ca-b91d-75387b1273bb tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:43.091565 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1406a9f2-53c7-49ca-b91d-75387b1273bb tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:43.092105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-1406a9f2-53c7-49ca-b91d-75387b1273bb tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lazy-loading 'fault' on Instance uuid f144c105-0d18-4e85-91fb-a54fee776414 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:20:43.136127 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1406a9f2-53c7-49ca-b91d-75387b1273bb tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:43.144150 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1406a9f2-53c7-49ca-b91d-75387b1273bb tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1303 microversion: 2.1 time: 0.099872 May 19 12:20:43.144727 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 222/388] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:43 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:43.702758 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-3e8422d9-cc7d-49df-844b-4665a851a773 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:43.703433 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-3e8422d9-cc7d-49df-844b-4665a851a773 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:43.710405 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3e8422d9-cc7d-49df-844b-4665a851a773 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:43.710891 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3e8422d9-cc7d-49df-844b-4665a851a773 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:43.712285 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3e8422d9-cc7d-49df-844b-4665a851a773 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:43.712593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3e8422d9-cc7d-49df-844b-4665a851a773 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:43.846199 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-3e8422d9-cc7d-49df-844b-4665a851a773 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:43.854485 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-3e8422d9-cc7d-49df-844b-4665a851a773 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1372 microversion: 2.1 time: 0.155884 May 19 12:20:43.854961 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 167/389] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:43 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:44.162188 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a423e6ce-6281-44fe-b2f8-257812a3a8c5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:44.171665 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a423e6ce-6281-44fe-b2f8-257812a3a8c5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:44.171665 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a423e6ce-6281-44fe-b2f8-257812a3a8c5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:44.171665 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a423e6ce-6281-44fe-b2f8-257812a3a8c5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:44.171665 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a423e6ce-6281-44fe-b2f8-257812a3a8c5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:44.172235 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a423e6ce-6281-44fe-b2f8-257812a3a8c5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:44.206694 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a423e6ce-6281-44fe-b2f8-257812a3a8c5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:44.207146 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a423e6ce-6281-44fe-b2f8-257812a3a8c5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:44.207599 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-a423e6ce-6281-44fe-b2f8-257812a3a8c5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lazy-loading 'fault' on Instance uuid f144c105-0d18-4e85-91fb-a54fee776414 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:20:44.256107 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a423e6ce-6281-44fe-b2f8-257812a3a8c5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:44.264746 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a423e6ce-6281-44fe-b2f8-257812a3a8c5 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1303 microversion: 2.1 time: 0.106524 May 19 12:20:44.285633 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 223/390] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:44 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:44.870631 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f0e4960b-1211-4100-ae56-a83284243dc4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:44.871260 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f0e4960b-1211-4100-ae56-a83284243dc4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:44.873790 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:44.878838 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f0e4960b-1211-4100-ae56-a83284243dc4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:44.879283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f0e4960b-1211-4100-ae56-a83284243dc4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:44.880077 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f0e4960b-1211-4100-ae56-a83284243dc4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:44.880507 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f0e4960b-1211-4100-ae56-a83284243dc4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:45.173579 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f0e4960b-1211-4100-ae56-a83284243dc4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:45.202036 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f0e4960b-1211-4100-ae56-a83284243dc4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1372 microversion: 2.1 time: 0.335213 May 19 12:20:45.231942 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 168/391] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:44 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1372 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:45.283901 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-cacc3e96-e989-4e72-b5db-388a26d5e070 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:45.296719 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-cacc3e96-e989-4e72-b5db-388a26d5e070 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:45.318492 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cacc3e96-e989-4e72-b5db-388a26d5e070 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:45.319382 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cacc3e96-e989-4e72-b5db-388a26d5e070 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:45.329619 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cacc3e96-e989-4e72-b5db-388a26d5e070 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:45.329619 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cacc3e96-e989-4e72-b5db-388a26d5e070 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:45.397403 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cacc3e96-e989-4e72-b5db-388a26d5e070 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:45.405302 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cacc3e96-e989-4e72-b5db-388a26d5e070 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:45.411293 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-cacc3e96-e989-4e72-b5db-388a26d5e070 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lazy-loading 'fault' on Instance uuid f144c105-0d18-4e85-91fb-a54fee776414 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:20:45.524644 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-cacc3e96-e989-4e72-b5db-388a26d5e070 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858ef1572f064c248592e92625b228f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e70c946e5440e39ee1d7cbeb0a4160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:45.536725 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-cacc3e96-e989-4e72-b5db-388a26d5e070 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 200 len: 1303 microversion: 2.1 time: 0.257931 May 19 12:20:45.538104 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 224/392] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:45 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 1303 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:20:46.240465 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-edde3f08-1c5c-4373-a532-5b29f0cf7f25 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:46.241191 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-edde3f08-1c5c-4373-a532-5b29f0cf7f25 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:46.251571 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-edde3f08-1c5c-4373-a532-5b29f0cf7f25 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:46.252123 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-edde3f08-1c5c-4373-a532-5b29f0cf7f25 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:46.253090 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-edde3f08-1c5c-4373-a532-5b29f0cf7f25 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:46.253532 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-edde3f08-1c5c-4373-a532-5b29f0cf7f25 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:46.557249 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2f2e1158-d785-443c-a2cb-2e125a291c18 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:46.557961 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2f2e1158-d785-443c-a2cb-2e125a291c18 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] [instance: f144c105-0d18-4e85-91fb-a54fee776414] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:46.564984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f2e1158-d785-443c-a2cb-2e125a291c18 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:46.565440 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f2e1158-d785-443c-a2cb-2e125a291c18 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:46.566246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f2e1158-d785-443c-a2cb-2e125a291c18 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:46.566668 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f2e1158-d785-443c-a2cb-2e125a291c18 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:46.582919 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-2f2e1158-d785-443c-a2cb-2e125a291c18 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] HTTP exception thrown: Instance f144c105-0d18-4e85-91fb-a54fee776414 could not be found. May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2f2e1158-d785-443c-a2cb-2e125a291c18 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Request method failure captured: May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 HTTP/1.1 May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjXW0F-KkSpZSH4tgBT4LRp5ZA96iVp5BF0nCu5OpwWAQ3I3EXglZMfWy1HaO7bjSAVK8D5_s-CectvV-R6RTrjhc2DTDs9btGI-_H9LIkN1E8JXKhE-AHEXlGA0tovIAxk4KXEDF0Rq_TsXp_cTGqM-uvAFaHSs66voEuYmCDEvKXM May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 79e70c946e5440e39ee1d7cbeb0a4160 May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-VolumesActionsTest-1497151799 May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:20:46.585099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:20:46.586831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_79e70c946e5440e39ee1d7cbeb0a4160"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79e70c946e5440e39ee1d7cbeb0a4160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/79e70c946e5440e39ee1d7cbeb0a4160"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79e70c946e5440e39ee1d7cbeb0a4160"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:20:46.586831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-VolumesActionsTest-1497151799 May 19 12:20:46.586831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 79e70c946e5440e39ee1d7cbeb0a4160 May 19 12:20:46.586831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-VolumesActionsTest-1497151799 May 19 12:20:46.586831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-VolumesActionsTest-1497151799-project May 19 12:20:46.586831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:20:46.586831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:20:46.586831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: 858ef1572f064c248592e92625b228f8 May 19 12:20:46.586831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-VolumesActionsTest-1497151799-project May 19 12:20:46.586831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:20:46.586831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance f144c105-0d18-4e85-91fb-a54fee776414 could not be found. May 19 12:20:46.586831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': 'f144c105-0d18-4e85-91fb-a54fee776414'} May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f144c105-0d18-4e85-91fb-a54fee776414 could not be found. May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:20:46.587692 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:20:46.589265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:20:46.589265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:20:46.589265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:20:46.589265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:20:46.589265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:20:46.589265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:20:46.589265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:20:46.589265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f144c105-0d18-4e85-91fb-a54fee776414 could not be found. May 19 12:20:46.589265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:20:46.589265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:20:46.589265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:20:46.589265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:20:46.589265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:20:46.589265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:20:46.589265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:20:46.589265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:20:46.589265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f144c105-0d18-4e85-91fb-a54fee776414 could not be found. May 19 12:20:46.589265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:20:46.596804 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2f2e1158-d785-443c-a2cb-2e125a291c18 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] Returning 404 to user: Instance f144c105-0d18-4e85-91fb-a54fee776414 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:20:46.596804 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2f2e1158-d785-443c-a2cb-2e125a291c18 tempest-VolumesActionsTest-1497151799 tempest-VolumesActionsTest-1497151799-project] 10.222.0.23 "GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414" status: 404 len: 111 microversion: 2.1 time: 0.037611 May 19 12:20:46.596804 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 225/393] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:46 2022] GET /compute/v2.1/servers/f144c105-0d18-4e85-91fb-a54fee776414 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:20:46.747323 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-edde3f08-1c5c-4373-a532-5b29f0cf7f25 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:20:46.757144 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-edde3f08-1c5c-4373-a532-5b29f0cf7f25 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1566 microversion: 2.1 time: 0.520863 May 19 12:20:46.769966 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 169/394] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:20:46 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1566 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:20:46.776380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-67c56686-1bde-48cc-880f-4c1e5c95df5a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:20:46.777834 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-67c56686-1bde-48cc-880f-4c1e5c95df5a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:20:46.793783 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-67c56686-1bde-48cc-880f-4c1e5c95df5a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:46.793999 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-67c56686-1bde-48cc-880f-4c1e5c95df5a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:46.795507 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-67c56686-1bde-48cc-880f-4c1e5c95df5a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:46.796383 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-67c56686-1bde-48cc-880f-4c1e5c95df5a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:46.933685 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-67c56686-1bde-48cc-880f-4c1e5c95df5a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.162501 May 19 12:20:46.934289 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 226/395] 10.222.0.23 () {58 vars in 1274 bytes} [Thu May 19 12:20:46 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:20:48.578824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-5bb87684-2224-477d-9ec7-809b53d35d0d req-ca3d6dee-a7a3-40ed-980c-87dbce20e904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caffcacb-8fb4-412e-ae78-67570b491068", "tag": "413f04d8-4ef0-4bef-8ee6-725aaa428db9"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:20:48.592528 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-5bb87684-2224-477d-9ec7-809b53d35d0d req-ca3d6dee-a7a3-40ed-980c-87dbce20e904 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:20:48.593671 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-5bb87684-2224-477d-9ec7-809b53d35d0d req-ca3d6dee-a7a3-40ed-980c-87dbce20e904 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:20:48.610706 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-5bb87684-2224-477d-9ec7-809b53d35d0d req-ca3d6dee-a7a3-40ed-980c-87dbce20e904 service nova] Creating event network-changed:413f04d8-4ef0-4bef-8ee6-725aaa428db9 for instance caffcacb-8fb4-412e-ae78-67570b491068 on hv-cinder-80475 May 19 12:20:48.619699 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-5bb87684-2224-477d-9ec7-809b53d35d0d req-ca3d6dee-a7a3-40ed-980c-87dbce20e904 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044811 May 19 12:20:48.627299 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 170/396] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:20:58.862847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:58.864270 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=87 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:59.248964 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7116e572-cf77-4533-8d99-3ffb86a2ad21 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Action: 'create', calling method: .version_select at 0x7f3b9db0af70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1388952173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4IAZxMkI1x7XSJHRrE+vy7TZ6ZTL+sCVWP/IjrFBIoVUc1JgQCn89sQC+TCO4/wpsWa6msR1jqlue4LcvSHLIFGJolWwwJ0fzzktMj+R4+fcumJp5E7aH3J/Q4kqy8kg=="}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:20:59.303536 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-7116e572-cf77-4533-8d99-3ffb86a2ad21 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Getting quotas for project 0beba4cdb9854497b6cedd3e76059e12. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:20:59.320773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-7116e572-cf77-4533-8d99-3ffb86a2ad21 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Getting quotas for user 3124804c65204e9e8dc4c26e572390b9 and project 0beba4cdb9854497b6cedd3e76059e12. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:20:59.439979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7116e572-cf77-4533-8d99-3ffb86a2ad21 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.577996 May 19 12:20:59.441007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 227/397] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 19 12:20:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:21:29.094901 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0b9ba790-5161-43eb-b886-512a4352a8e3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:29.095537 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0b9ba790-5161-43eb-b886-512a4352a8e3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:29.099079 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=5 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:29.099771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:29.105194 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0b9ba790-5161-43eb-b886-512a4352a8e3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:29.105653 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0b9ba790-5161-43eb-b886-512a4352a8e3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:29.106443 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0b9ba790-5161-43eb-b886-512a4352a8e3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:29.107464 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0b9ba790-5161-43eb-b886-512a4352a8e3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:29.133762 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0b9ba790-5161-43eb-b886-512a4352a8e3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0/ips" status: 200 len: 146 microversion: 2.1 time: 0.045496 May 19 12:21:29.134713 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 171/398] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 19 12:21:29 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:21:30.091730 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:21:30.092015 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Thu May 19 12:21:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:21:35.300941 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=4 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:35.301779 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:35.313594 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2e0da59e-f236-41aa-803f-424e608cf2cd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f07496e-cbbc-4120-b441-1166ffbdd1d3"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:21:35.315251 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2e0da59e-f236-41aa-803f-424e608cf2cd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:35.326762 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2e0da59e-f236-41aa-803f-424e608cf2cd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:35.328413 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2e0da59e-f236-41aa-803f-424e608cf2cd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:35.329603 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2e0da59e-f236-41aa-803f-424e608cf2cd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:35.330707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2e0da59e-f236-41aa-803f-424e608cf2cd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:36.576788 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2e0da59e-f236-41aa-803f-424e608cf2cd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "POST /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.261324 May 19 12:21:36.576788 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 228/399] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 19 12:21:35 2022] POST /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0/os-volume_attachments => generated 194 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:21:37.341933 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-abc1c388-e904-4ffb-8065-484bb2b33573 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1717457314", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1388952173", "security_groups": [{"name": "tempest-secgroup-smoke-451457986"}], "networks": [{"uuid": "2237e2b2-7c53-4199-a822-e417750a80fa"}], "block_device_mapping_v2": [{"uuid": "aeaaff77-6b13-4758-9c49-17f8a7509345", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:21:37.475921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.network.neutron [None req-abc1c388-e904-4ffb-8065-484bb2b33573 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] validate_networks() for [('2237e2b2-7c53-4199-a822-e417750a80fa', None, None, None, None, None)] {{(pid=117964) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:21:37.948173 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-abc1c388-e904-4ffb-8065-484bb2b33573 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Flavor limits 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:21:37.948600 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-abc1c388-e904-4ffb-8065-484bb2b33573 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Image limits 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:21:37.949075 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-abc1c388-e904-4ffb-8065-484bb2b33573 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Flavor pref 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:21:37.949487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-abc1c388-e904-4ffb-8065-484bb2b33573 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Image pref 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:21:37.950540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-abc1c388-e904-4ffb-8065-484bb2b33573 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:21:37.961854 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-abc1c388-e904-4ffb-8065-484bb2b33573 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:37.963001 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-abc1c388-e904-4ffb-8065-484bb2b33573 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:37.963849 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-abc1c388-e904-4ffb-8065-484bb2b33573 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:37.964606 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-abc1c388-e904-4ffb-8065-484bb2b33573 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:37.986024 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-abc1c388-e904-4ffb-8065-484bb2b33573 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Getting quotas for project 0beba4cdb9854497b6cedd3e76059e12. Resources: {'instances', 'ram', 'cores'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:21:37.990790 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-abc1c388-e904-4ffb-8065-484bb2b33573 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Getting quotas for user 3124804c65204e9e8dc4c26e572390b9 and project 0beba4cdb9854497b6cedd3e76059e12. Resources: {'instances', 'ram', 'cores'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:21:38.064675 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-abc1c388-e904-4ffb-8065-484bb2b33573 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Going to run 1 instances... {{(pid=117964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:21:38.064675 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-abc1c388-e904-4ffb-8065-484bb2b33573 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aeaaff77-6b13-4758-9c49-17f8a7509345',volume_size=None,volume_type=None)] {{(pid=117964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:21:38.644489 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-abc1c388-e904-4ffb-8065-484bb2b33573 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.313610 May 19 12:21:38.652251 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 172/400] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:21:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 1322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:21:38.659372 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-234bb165-116f-4ec1-8464-7b136f3975a9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:38.660566 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-234bb165-116f-4ec1-8464-7b136f3975a9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:38.734342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-234bb165-116f-4ec1-8464-7b136f3975a9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:38.745607 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-234bb165-116f-4ec1-8464-7b136f3975a9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1089 microversion: 2.1 time: 0.090368 May 19 12:21:38.748327 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 229/401] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:38 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1089 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:39.766933 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a1e93638-5211-4724-b9bb-4c2faf7a11b4 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:39.767558 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a1e93638-5211-4724-b9bb-4c2faf7a11b4 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:39.839440 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a1e93638-5211-4724-b9bb-4c2faf7a11b4 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:39.853026 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a1e93638-5211-4724-b9bb-4c2faf7a11b4 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1089 microversion: 2.1 time: 0.089409 May 19 12:21:39.863757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 173/402] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:39 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1089 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:40.877013 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9dae3f2d-95ec-4359-b073-8927444c220c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:40.878484 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9dae3f2d-95ec-4359-b073-8927444c220c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:40.889652 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9dae3f2d-95ec-4359-b073-8927444c220c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:40.890963 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9dae3f2d-95ec-4359-b073-8927444c220c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:40.892166 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9dae3f2d-95ec-4359-b073-8927444c220c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:40.892774 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9dae3f2d-95ec-4359-b073-8927444c220c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:41.011384 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9dae3f2d-95ec-4359-b073-8927444c220c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:41.024056 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9dae3f2d-95ec-4359-b073-8927444c220c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1139 microversion: 2.1 time: 0.153471 May 19 12:21:41.033639 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 230/403] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:40 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1139 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:42.041630 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a7c52a46-7266-4a58-bb72-a7bffe53cf39 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:42.042231 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a7c52a46-7266-4a58-bb72-a7bffe53cf39 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:42.050127 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a7c52a46-7266-4a58-bb72-a7bffe53cf39 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:42.050575 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a7c52a46-7266-4a58-bb72-a7bffe53cf39 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:42.051350 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a7c52a46-7266-4a58-bb72-a7bffe53cf39 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:42.051777 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a7c52a46-7266-4a58-bb72-a7bffe53cf39 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:42.120209 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a7c52a46-7266-4a58-bb72-a7bffe53cf39 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:42.129340 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a7c52a46-7266-4a58-bb72-a7bffe53cf39 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1187 microversion: 2.1 time: 0.092266 May 19 12:21:42.129900 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 174/404] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:42 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:21:43.146257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-cfb2144e-6940-4761-948b-71405bf3e42b tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:43.147036 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-cfb2144e-6940-4761-948b-71405bf3e42b tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:43.156890 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cfb2144e-6940-4761-948b-71405bf3e42b tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:43.157949 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cfb2144e-6940-4761-948b-71405bf3e42b tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:43.158845 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cfb2144e-6940-4761-948b-71405bf3e42b tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:43.159320 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cfb2144e-6940-4761-948b-71405bf3e42b tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:43.276109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-cfb2144e-6940-4761-948b-71405bf3e42b tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:43.297182 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-cfb2144e-6940-4761-948b-71405bf3e42b tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1195 microversion: 2.1 time: 0.149807 May 19 12:21:43.298184 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 231/405] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:43 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1195 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:43.457352 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-22a22bee-c3f1-4667-b8e3-1052e3cfbcee tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:43.460169 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-22a22bee-c3f1-4667-b8e3-1052e3cfbcee tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:43.468612 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-22a22bee-c3f1-4667-b8e3-1052e3cfbcee tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:43.469174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-22a22bee-c3f1-4667-b8e3-1052e3cfbcee tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:43.470134 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-22a22bee-c3f1-4667-b8e3-1052e3cfbcee tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:43.470845 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-22a22bee-c3f1-4667-b8e3-1052e3cfbcee tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:43.504684 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-22a22bee-c3f1-4667-b8e3-1052e3cfbcee tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85/ips" status: 200 len: 148 microversion: 2.1 time: 0.051451 May 19 12:21:43.512526 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 175/406] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 19 12:21:43 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85/ips => generated 148 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:21:44.329856 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ac8c1520-1b7a-4895-8dc7-6037001e572e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:44.331183 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ac8c1520-1b7a-4895-8dc7-6037001e572e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:44.341745 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ac8c1520-1b7a-4895-8dc7-6037001e572e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:44.342502 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ac8c1520-1b7a-4895-8dc7-6037001e572e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:44.344661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ac8c1520-1b7a-4895-8dc7-6037001e572e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:44.345310 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ac8c1520-1b7a-4895-8dc7-6037001e572e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:44.448781 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ac8c1520-1b7a-4895-8dc7-6037001e572e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:44.461268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ac8c1520-1b7a-4895-8dc7-6037001e572e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1205 microversion: 2.1 time: 0.136817 May 19 12:21:44.462610 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 232/407] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:44 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1205 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:45.479560 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d634c30e-8938-4578-a3ab-395ba8e88717 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:45.480334 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d634c30e-8938-4578-a3ab-395ba8e88717 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:45.488022 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d634c30e-8938-4578-a3ab-395ba8e88717 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:45.488400 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d634c30e-8938-4578-a3ab-395ba8e88717 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:45.489183 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d634c30e-8938-4578-a3ab-395ba8e88717 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:45.489605 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d634c30e-8938-4578-a3ab-395ba8e88717 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:45.659497 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d634c30e-8938-4578-a3ab-395ba8e88717 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:45.668198 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d634c30e-8938-4578-a3ab-395ba8e88717 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1272 microversion: 2.1 time: 0.192967 May 19 12:21:45.675347 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 176/408] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:45 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1272 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:46.466059 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d72379e0-eeaf-4523-bc69-7c53526d0b2e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:21:46.506875 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d72379e0-eeaf-4523-bc69-7c53526d0b2e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:46.511617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d72379e0-eeaf-4523-bc69-7c53526d0b2e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:46.692166 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-02bbc251-8399-43aa-b492-a3eb14a098e7 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:46.713889 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-02bbc251-8399-43aa-b492-a3eb14a098e7 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:46.743891 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-02bbc251-8399-43aa-b492-a3eb14a098e7 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:46.774459 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-02bbc251-8399-43aa-b492-a3eb14a098e7 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:46.776892 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-02bbc251-8399-43aa-b492-a3eb14a098e7 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:46.777915 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-02bbc251-8399-43aa-b492-a3eb14a098e7 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:46.786842 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d72379e0-eeaf-4523-bc69-7c53526d0b2e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Going to try to stop instance {{(pid=117963) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 12:21:47.104396 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-02bbc251-8399-43aa-b492-a3eb14a098e7 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:47.113612 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-02bbc251-8399-43aa-b492-a3eb14a098e7 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1272 microversion: 2.1 time: 0.430317 May 19 12:21:47.114641 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 177/409] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:46 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1272 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:47.218459 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d72379e0-eeaf-4523-bc69-7c53526d0b2e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "POST /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0/action" status: 202 len: 0 microversion: 2.1 time: 0.761199 May 19 12:21:47.223438 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 233/410] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 19 12:21:46 2022] POST /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0/action => generated 0 bytes in 763 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:21:47.232622 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-8966f2b8-c7c3-40e9-a336-fefb58c76204 req-f229a64a-f014-427f-b2a3-7e35f59b411c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9431305d-b1c8-46c1-9625-0d2e0643174e", "tag": "d1aaf37f-d3ed-4dc1-91e2-f291ae051dbf"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:21:47.244966 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-148ba48c-38e9-4bba-ac69-548c739c0de2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:47.247119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-148ba48c-38e9-4bba-ac69-548c739c0de2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:47.251917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-8966f2b8-c7c3-40e9-a336-fefb58c76204 req-f229a64a-f014-427f-b2a3-7e35f59b411c service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:47.257110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-8966f2b8-c7c3-40e9-a336-fefb58c76204 req-f229a64a-f014-427f-b2a3-7e35f59b411c service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:47.276670 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-148ba48c-38e9-4bba-ac69-548c739c0de2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:47.279263 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-148ba48c-38e9-4bba-ac69-548c739c0de2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:47.283973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-8966f2b8-c7c3-40e9-a336-fefb58c76204 req-f229a64a-f014-427f-b2a3-7e35f59b411c service nova] Creating event network-changed:d1aaf37f-d3ed-4dc1-91e2-f291ae051dbf for instance 9431305d-b1c8-46c1-9625-0d2e0643174e on hv-cinder-80475 May 19 12:21:47.290086 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-148ba48c-38e9-4bba-ac69-548c739c0de2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:47.290562 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-148ba48c-38e9-4bba-ac69-548c739c0de2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:47.311930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-8966f2b8-c7c3-40e9-a336-fefb58c76204 req-f229a64a-f014-427f-b2a3-7e35f59b411c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086235 May 19 12:21:47.312914 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 234/411] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:21:47.368333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8857ca68-02af-4a6d-8c36-30de5a94f43c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df9d793b-c31e-4feb-9ebb-651e35ef8881"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:21:47.370519 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8857ca68-02af-4a6d-8c36-30de5a94f43c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:47.387008 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8857ca68-02af-4a6d-8c36-30de5a94f43c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:47.387896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8857ca68-02af-4a6d-8c36-30de5a94f43c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:47.388985 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8857ca68-02af-4a6d-8c36-30de5a94f43c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:47.389628 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8857ca68-02af-4a6d-8c36-30de5a94f43c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:47.620118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-148ba48c-38e9-4bba-ac69-548c739c0de2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:47.632545 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-148ba48c-38e9-4bba-ac69-548c739c0de2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1724 microversion: 2.1 time: 0.407858 May 19 12:21:47.640438 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 178/412] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:47 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1724 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:48.134376 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c5a1ad54-b5df-48f5-9ba2-fac653fe099c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:48.135822 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c5a1ad54-b5df-48f5-9ba2-fac653fe099c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:48.138445 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=2 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:48.156816 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c5a1ad54-b5df-48f5-9ba2-fac653fe099c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:48.157148 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c5a1ad54-b5df-48f5-9ba2-fac653fe099c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:48.157930 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c5a1ad54-b5df-48f5-9ba2-fac653fe099c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:48.159577 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c5a1ad54-b5df-48f5-9ba2-fac653fe099c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:48.409987 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c5a1ad54-b5df-48f5-9ba2-fac653fe099c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:48.441082 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c5a1ad54-b5df-48f5-9ba2-fac653fe099c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1272 microversion: 2.1 time: 0.308827 May 19 12:21:48.447021 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 179/413] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:48 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1272 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:48.660383 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-77371647-030b-4a02-9223-25d0fda0a4b4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:48.661086 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-77371647-030b-4a02-9223-25d0fda0a4b4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:48.669871 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-77371647-030b-4a02-9223-25d0fda0a4b4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:48.672471 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-77371647-030b-4a02-9223-25d0fda0a4b4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:48.672471 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-77371647-030b-4a02-9223-25d0fda0a4b4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:48.674798 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8857ca68-02af-4a6d-8c36-30de5a94f43c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "POST /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.311735 May 19 12:21:48.675304 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-77371647-030b-4a02-9223-25d0fda0a4b4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:48.676100 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 235/414] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 19 12:21:47 2022] POST /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85/os-volume_attachments => generated 194 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:21:48.896142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-77371647-030b-4a02-9223-25d0fda0a4b4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:48.915962 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-77371647-030b-4a02-9223-25d0fda0a4b4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1724 microversion: 2.1 time: 0.257480 May 19 12:21:48.918790 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 180/415] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:48 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:49.464280 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-88b41a01-759d-47b1-9534-595ccf694604 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:49.465902 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-88b41a01-759d-47b1-9534-595ccf694604 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:49.468075 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:49.476185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-88b41a01-759d-47b1-9534-595ccf694604 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:49.477088 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-88b41a01-759d-47b1-9534-595ccf694604 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:49.477867 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-88b41a01-759d-47b1-9534-595ccf694604 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:49.478644 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-88b41a01-759d-47b1-9534-595ccf694604 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:49.635574 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-88b41a01-759d-47b1-9534-595ccf694604 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:49.645785 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-88b41a01-759d-47b1-9534-595ccf694604 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.187787 May 19 12:21:49.646372 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 236/416] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:49 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:49.935891 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f31f599a-9122-4935-be46-3f1cf2f1fd66 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:49.936605 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f31f599a-9122-4935-be46-3f1cf2f1fd66 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:49.939224 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=8 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:49.944735 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f31f599a-9122-4935-be46-3f1cf2f1fd66 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:49.945305 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f31f599a-9122-4935-be46-3f1cf2f1fd66 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:49.946689 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f31f599a-9122-4935-be46-3f1cf2f1fd66 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:49.947238 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f31f599a-9122-4935-be46-3f1cf2f1fd66 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:50.086586 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f31f599a-9122-4935-be46-3f1cf2f1fd66 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:50.094820 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f31f599a-9122-4935-be46-3f1cf2f1fd66 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1724 microversion: 2.1 time: 0.163016 May 19 12:21:50.100327 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 181/417] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:49 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:50.665442 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c024d378-5cba-44f3-afdc-91ba695acf78 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:50.666205 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c024d378-5cba-44f3-afdc-91ba695acf78 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:50.673238 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c024d378-5cba-44f3-afdc-91ba695acf78 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:50.673797 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c024d378-5cba-44f3-afdc-91ba695acf78 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:50.674649 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c024d378-5cba-44f3-afdc-91ba695acf78 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:50.675155 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c024d378-5cba-44f3-afdc-91ba695acf78 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:50.830797 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c024d378-5cba-44f3-afdc-91ba695acf78 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:50.841328 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c024d378-5cba-44f3-afdc-91ba695acf78 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.180847 May 19 12:21:50.842021 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 237/418] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:50 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:51.112606 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-2c7c4c8a-16ea-4716-955c-cf78ddf23729 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:51.115416 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-2c7c4c8a-16ea-4716-955c-cf78ddf23729 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:51.122633 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2c7c4c8a-16ea-4716-955c-cf78ddf23729 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:51.123090 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2c7c4c8a-16ea-4716-955c-cf78ddf23729 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:51.123893 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2c7c4c8a-16ea-4716-955c-cf78ddf23729 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:51.124334 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2c7c4c8a-16ea-4716-955c-cf78ddf23729 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:51.280055 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-2c7c4c8a-16ea-4716-955c-cf78ddf23729 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:51.288842 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-2c7c4c8a-16ea-4716-955c-cf78ddf23729 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1724 microversion: 2.1 time: 0.180316 May 19 12:21:51.289374 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 182/419] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:51 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:51.859943 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-cdb393af-f867-4ae7-bc07-0bbc2175613a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:51.861405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-cdb393af-f867-4ae7-bc07-0bbc2175613a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:51.869628 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cdb393af-f867-4ae7-bc07-0bbc2175613a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:51.870445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cdb393af-f867-4ae7-bc07-0bbc2175613a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:51.871455 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cdb393af-f867-4ae7-bc07-0bbc2175613a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:51.872126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cdb393af-f867-4ae7-bc07-0bbc2175613a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:52.045506 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-cdb393af-f867-4ae7-bc07-0bbc2175613a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:52.053553 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-cdb393af-f867-4ae7-bc07-0bbc2175613a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.197858 May 19 12:21:52.057321 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 238/420] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:51 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:52.306205 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-aeaf65a7-ee5f-4597-87e2-b4fccbc60241 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:52.307486 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-aeaf65a7-ee5f-4597-87e2-b4fccbc60241 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:52.316377 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-aeaf65a7-ee5f-4597-87e2-b4fccbc60241 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:52.317208 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-aeaf65a7-ee5f-4597-87e2-b4fccbc60241 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:52.318307 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-aeaf65a7-ee5f-4597-87e2-b4fccbc60241 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:52.318816 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-aeaf65a7-ee5f-4597-87e2-b4fccbc60241 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:52.466751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-aeaf65a7-ee5f-4597-87e2-b4fccbc60241 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:52.479480 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-aeaf65a7-ee5f-4597-87e2-b4fccbc60241 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1724 microversion: 2.1 time: 0.176095 May 19 12:21:52.480603 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 183/421] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:52 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:53.075008 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-af18886a-5928-46af-bd8c-410e992bce41 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:53.076431 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-af18886a-5928-46af-bd8c-410e992bce41 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:53.084140 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-af18886a-5928-46af-bd8c-410e992bce41 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:53.084597 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-af18886a-5928-46af-bd8c-410e992bce41 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:53.085562 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-af18886a-5928-46af-bd8c-410e992bce41 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:53.085820 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-af18886a-5928-46af-bd8c-410e992bce41 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:53.239567 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-af18886a-5928-46af-bd8c-410e992bce41 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:53.249052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-af18886a-5928-46af-bd8c-410e992bce41 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.178982 May 19 12:21:53.249649 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 239/422] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:53 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:53.497737 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-520ad88a-e5df-490b-b65c-cf2781bde486 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:53.498261 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-520ad88a-e5df-490b-b65c-cf2781bde486 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:53.505052 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-520ad88a-e5df-490b-b65c-cf2781bde486 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:53.505453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-520ad88a-e5df-490b-b65c-cf2781bde486 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:53.506296 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-520ad88a-e5df-490b-b65c-cf2781bde486 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:53.506815 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-520ad88a-e5df-490b-b65c-cf2781bde486 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:53.642444 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-520ad88a-e5df-490b-b65c-cf2781bde486 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:53.651518 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-520ad88a-e5df-490b-b65c-cf2781bde486 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1724 microversion: 2.1 time: 0.157783 May 19 12:21:53.652131 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 184/423] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:53 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:54.267892 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c298f105-163d-4cb6-8aae-0a843c67d3a4 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:54.268459 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c298f105-163d-4cb6-8aae-0a843c67d3a4 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:54.276081 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c298f105-163d-4cb6-8aae-0a843c67d3a4 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:54.276667 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c298f105-163d-4cb6-8aae-0a843c67d3a4 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:54.277567 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c298f105-163d-4cb6-8aae-0a843c67d3a4 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:54.278035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c298f105-163d-4cb6-8aae-0a843c67d3a4 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:54.413025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c298f105-163d-4cb6-8aae-0a843c67d3a4 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:54.421624 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c298f105-163d-4cb6-8aae-0a843c67d3a4 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.157625 May 19 12:21:54.422225 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 240/424] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:54 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:54.671110 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e387e18d-4d99-4ce8-af9a-4341c1cac6b8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:54.671921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e387e18d-4d99-4ce8-af9a-4341c1cac6b8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:54.678890 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e387e18d-4d99-4ce8-af9a-4341c1cac6b8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:54.679428 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e387e18d-4d99-4ce8-af9a-4341c1cac6b8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:54.680770 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e387e18d-4d99-4ce8-af9a-4341c1cac6b8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:54.681535 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e387e18d-4d99-4ce8-af9a-4341c1cac6b8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:54.823127 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e387e18d-4d99-4ce8-af9a-4341c1cac6b8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:54.831887 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e387e18d-4d99-4ce8-af9a-4341c1cac6b8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1724 microversion: 2.1 time: 0.164658 May 19 12:21:54.837606 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 185/425] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:54 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:55.438679 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b49ab7ca-3a0b-44de-89d3-f77565308044 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:55.439363 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b49ab7ca-3a0b-44de-89d3-f77565308044 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:55.446666 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b49ab7ca-3a0b-44de-89d3-f77565308044 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:55.447115 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b49ab7ca-3a0b-44de-89d3-f77565308044 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:55.448096 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b49ab7ca-3a0b-44de-89d3-f77565308044 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:55.448539 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b49ab7ca-3a0b-44de-89d3-f77565308044 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:55.494342 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-876810ad-2dd2-4fff-99b5-d6f72d011687 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Action: 'create', calling method: .version_select at 0x7f3b9da533a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-696951433", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQgVSPM6CQd8naShOexVeyhIrYS9hUIvzRJOdCfNihraFmJWT9flehc7Js3CobPilr9VT6Qe9OKrMPGLDCbGze1Ddmg3AuHV2W0F0abAIorIQxty/DdJOmiNsXOJZ8SQw=="}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:21:55.509918 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-876810ad-2dd2-4fff-99b5-d6f72d011687 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Getting quotas for project 37c1366ee71c446b9ec6fa532391b789. Resources: {'key_pairs'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:21:55.514061 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-876810ad-2dd2-4fff-99b5-d6f72d011687 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Getting quotas for user d53ee7f4a9b74ce1868715ed0177bf2a and project 37c1366ee71c446b9ec6fa532391b789. Resources: {'key_pairs'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:21:55.586714 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b49ab7ca-3a0b-44de-89d3-f77565308044 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:55.594386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b49ab7ca-3a0b-44de-89d3-f77565308044 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.159575 May 19 12:21:55.594958 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 241/426] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:55 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:55.609192 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-876810ad-2dd2-4fff-99b5-d6f72d011687 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.118748 May 19 12:21:55.609801 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 186/427] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 19 12:21:55 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:21:55.661277 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5ebb86cd-c65f-4a62-8ea7-829d9a4effb3 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1759513588", "imageRef": "cf808353-e0f1-43aa-8057-6a7deb945460", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-696951433", "networks": [{"uuid": "4fc84730-31b5-4522-8209-b6ce187a5147"}]}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:21:55.711824 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-5ebb86cd-c65f-4a62-8ea7-829d9a4effb3 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] validate_networks() for [('4fc84730-31b5-4522-8209-b6ce187a5147', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:21:55.849076 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-4e07b41d-b423-4678-af6b-878fdd8d1c95 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:55.849690 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-4e07b41d-b423-4678-af6b-878fdd8d1c95 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:55.857083 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4e07b41d-b423-4678-af6b-878fdd8d1c95 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:55.857536 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4e07b41d-b423-4678-af6b-878fdd8d1c95 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:55.858315 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4e07b41d-b423-4678-af6b-878fdd8d1c95 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:55.858997 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4e07b41d-b423-4678-af6b-878fdd8d1c95 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:56.069441 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-4e07b41d-b423-4678-af6b-878fdd8d1c95 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:56.078615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-4e07b41d-b423-4678-af6b-878fdd8d1c95 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1724 microversion: 2.1 time: 0.233311 May 19 12:21:56.079202 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 187/428] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:55 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:56.154392 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-5ebb86cd-c65f-4a62-8ea7-829d9a4effb3 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:21:56.154821 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-5ebb86cd-c65f-4a62-8ea7-829d9a4effb3 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:21:56.155294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-5ebb86cd-c65f-4a62-8ea7-829d9a4effb3 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:21:56.155707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-5ebb86cd-c65f-4a62-8ea7-829d9a4effb3 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:21:56.156148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-5ebb86cd-c65f-4a62-8ea7-829d9a4effb3 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:21:56.166322 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ebb86cd-c65f-4a62-8ea7-829d9a4effb3 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:56.166770 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ebb86cd-c65f-4a62-8ea7-829d9a4effb3 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:56.167767 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ebb86cd-c65f-4a62-8ea7-829d9a4effb3 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:56.168241 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ebb86cd-c65f-4a62-8ea7-829d9a4effb3 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:56.192219 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-5ebb86cd-c65f-4a62-8ea7-829d9a4effb3 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Getting quotas for project 37c1366ee71c446b9ec6fa532391b789. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:21:56.196882 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-5ebb86cd-c65f-4a62-8ea7-829d9a4effb3 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Getting quotas for user d53ee7f4a9b74ce1868715ed0177bf2a and project 37c1366ee71c446b9ec6fa532391b789. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:21:56.208362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5ebb86cd-c65f-4a62-8ea7-829d9a4effb3 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:21:56.210591 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5ebb86cd-c65f-4a62-8ea7-829d9a4effb3 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf808353-e0f1-43aa-8057-6a7deb945460',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:21:56.385905 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5ebb86cd-c65f-4a62-8ea7-829d9a4effb3 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728279 May 19 12:21:56.386642 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 242/429] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:21:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:21:56.396678 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-54683741-2a25-4ba3-a7e7-5e16a88c9cfa tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:56.397291 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-54683741-2a25-4ba3-a7e7-5e16a88c9cfa tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:56.454024 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-54683741-2a25-4ba3-a7e7-5e16a88c9cfa tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:56.461826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-54683741-2a25-4ba3-a7e7-5e16a88c9cfa tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1258 microversion: 2.1 time: 0.068935 May 19 12:21:56.462491 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 188/430] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:56 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:56.613392 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ce45617d-a606-4c83-9c6b-f805228c9889 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:56.613998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ce45617d-a606-4c83-9c6b-f805228c9889 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:56.622495 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ce45617d-a606-4c83-9c6b-f805228c9889 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:56.622990 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ce45617d-a606-4c83-9c6b-f805228c9889 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:56.623647 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ce45617d-a606-4c83-9c6b-f805228c9889 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:56.624114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ce45617d-a606-4c83-9c6b-f805228c9889 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:56.628381 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:56.759283 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ce45617d-a606-4c83-9c6b-f805228c9889 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:56.766952 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ce45617d-a606-4c83-9c6b-f805228c9889 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.158468 May 19 12:21:56.767526 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 243/431] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:56 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:57.095187 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d04b8dc1-a7c1-42c6-8483-c8866b59011e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:57.095890 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d04b8dc1-a7c1-42c6-8483-c8866b59011e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:57.102690 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d04b8dc1-a7c1-42c6-8483-c8866b59011e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:57.103111 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d04b8dc1-a7c1-42c6-8483-c8866b59011e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:57.104115 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d04b8dc1-a7c1-42c6-8483-c8866b59011e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:57.104440 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d04b8dc1-a7c1-42c6-8483-c8866b59011e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:57.237966 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d04b8dc1-a7c1-42c6-8483-c8866b59011e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:57.246233 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d04b8dc1-a7c1-42c6-8483-c8866b59011e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1724 microversion: 2.1 time: 0.154926 May 19 12:21:57.246809 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 189/432] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:57 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:57.479858 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c1a1f049-6075-4fc8-856a-b3ee7bd93f7f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:57.480474 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c1a1f049-6075-4fc8-856a-b3ee7bd93f7f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:57.537048 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c1a1f049-6075-4fc8-856a-b3ee7bd93f7f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:57.546039 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c1a1f049-6075-4fc8-856a-b3ee7bd93f7f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1258 microversion: 2.1 time: 0.070684 May 19 12:21:57.546840 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 244/433] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:57 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:21:57.783951 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-dcc11a81-f561-4239-bbfe-653bb7d48750 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:57.784476 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-dcc11a81-f561-4239-bbfe-653bb7d48750 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:57.791384 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dcc11a81-f561-4239-bbfe-653bb7d48750 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:57.791861 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dcc11a81-f561-4239-bbfe-653bb7d48750 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:57.792679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dcc11a81-f561-4239-bbfe-653bb7d48750 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:57.793112 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dcc11a81-f561-4239-bbfe-653bb7d48750 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:57.932525 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-dcc11a81-f561-4239-bbfe-653bb7d48750 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:57.940518 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-dcc11a81-f561-4239-bbfe-653bb7d48750 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.160545 May 19 12:21:57.941084 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 190/434] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:57 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:58.262928 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9b7bd3a4-3ca7-456d-873e-1ed771b7593b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:58.263546 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9b7bd3a4-3ca7-456d-873e-1ed771b7593b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:58.270179 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9b7bd3a4-3ca7-456d-873e-1ed771b7593b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:58.270639 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9b7bd3a4-3ca7-456d-873e-1ed771b7593b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:58.271409 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9b7bd3a4-3ca7-456d-873e-1ed771b7593b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:58.271879 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9b7bd3a4-3ca7-456d-873e-1ed771b7593b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:58.405138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9b7bd3a4-3ca7-456d-873e-1ed771b7593b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:58.413273 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9b7bd3a4-3ca7-456d-873e-1ed771b7593b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1724 microversion: 2.1 time: 0.154613 May 19 12:21:58.413937 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 245/435] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:58 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:58.563205 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-3304c733-f76c-4bb6-a0e0-c2148f1fce86 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:58.563879 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-3304c733-f76c-4bb6-a0e0-c2148f1fce86 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:58.571160 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3304c733-f76c-4bb6-a0e0-c2148f1fce86 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:58.571739 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3304c733-f76c-4bb6-a0e0-c2148f1fce86 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:58.572548 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3304c733-f76c-4bb6-a0e0-c2148f1fce86 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:58.572993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3304c733-f76c-4bb6-a0e0-c2148f1fce86 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:58.635417 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-3304c733-f76c-4bb6-a0e0-c2148f1fce86 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:58.639184 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=100 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:58.643804 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-3304c733-f76c-4bb6-a0e0-c2148f1fce86 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1262 microversion: 2.1 time: 0.084247 May 19 12:21:58.644942 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 191/436] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:58 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:58.959443 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ac1cc341-c445-49df-9cf3-91fa554a1ee1 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:58.960111 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ac1cc341-c445-49df-9cf3-91fa554a1ee1 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:58.969022 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ac1cc341-c445-49df-9cf3-91fa554a1ee1 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:58.969879 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ac1cc341-c445-49df-9cf3-91fa554a1ee1 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:58.971101 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ac1cc341-c445-49df-9cf3-91fa554a1ee1 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:58.971328 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ac1cc341-c445-49df-9cf3-91fa554a1ee1 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:59.329739 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ac1cc341-c445-49df-9cf3-91fa554a1ee1 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:59.340767 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ac1cc341-c445-49df-9cf3-91fa554a1ee1 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.386069 May 19 12:21:59.341425 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 246/437] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:58 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:59.431053 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-72868a5e-9d76-4743-b9bb-50793a2ef785 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:59.431655 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-72868a5e-9d76-4743-b9bb-50793a2ef785 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:59.438490 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-72868a5e-9d76-4743-b9bb-50793a2ef785 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:59.438939 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-72868a5e-9d76-4743-b9bb-50793a2ef785 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:59.439722 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-72868a5e-9d76-4743-b9bb-50793a2ef785 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:59.440194 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-72868a5e-9d76-4743-b9bb-50793a2ef785 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:59.572215 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-72868a5e-9d76-4743-b9bb-50793a2ef785 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:59.580281 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-72868a5e-9d76-4743-b9bb-50793a2ef785 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1701 microversion: 2.1 time: 0.153689 May 19 12:21:59.580848 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 192/438] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:59 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1701 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:59.602244 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d27e737e-7667-42f0-9796-88205499badd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:21:59.609142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d27e737e-7667-42f0-9796-88205499badd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:59.609591 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d27e737e-7667-42f0-9796-88205499badd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:59.632394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d27e737e-7667-42f0-9796-88205499badd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Going to try to start instance {{(pid=117963) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 12:21:59.661742 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a26c96bb-d052-4efd-8d1d-4ed99b8416f7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:59.662371 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a26c96bb-d052-4efd-8d1d-4ed99b8416f7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:59.669870 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a26c96bb-d052-4efd-8d1d-4ed99b8416f7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:59.670312 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a26c96bb-d052-4efd-8d1d-4ed99b8416f7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:59.671110 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a26c96bb-d052-4efd-8d1d-4ed99b8416f7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:59.671572 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a26c96bb-d052-4efd-8d1d-4ed99b8416f7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:59.734275 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a26c96bb-d052-4efd-8d1d-4ed99b8416f7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:21:59.741954 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a26c96bb-d052-4efd-8d1d-4ed99b8416f7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1310 microversion: 2.1 time: 0.084058 May 19 12:21:59.742558 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 193/439] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:59 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:21:59.902200 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d27e737e-7667-42f0-9796-88205499badd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "POST /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0/action" status: 202 len: 0 microversion: 2.1 time: 0.304249 May 19 12:21:59.903770 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 247/440] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 19 12:21:59 2022] POST /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:21:59.911306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e4d7c79b-7118-4957-ba97-34e55e1a574c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:21:59.911944 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e4d7c79b-7118-4957-ba97-34e55e1a574c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:21:59.918421 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e4d7c79b-7118-4957-ba97-34e55e1a574c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:59.918873 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e4d7c79b-7118-4957-ba97-34e55e1a574c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:21:59.919658 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e4d7c79b-7118-4957-ba97-34e55e1a574c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:21:59.920121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e4d7c79b-7118-4957-ba97-34e55e1a574c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:00.078629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e4d7c79b-7118-4957-ba97-34e55e1a574c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:00.089615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e4d7c79b-7118-4957-ba97-34e55e1a574c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1710 microversion: 2.1 time: 0.182343 May 19 12:22:00.090448 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 194/441] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:21:59 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1710 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:00.362040 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f181c6e4-e622-4756-a64c-02c911c388b3 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:00.362821 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f181c6e4-e622-4756-a64c-02c911c388b3 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:00.369952 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f181c6e4-e622-4756-a64c-02c911c388b3 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:00.370428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f181c6e4-e622-4756-a64c-02c911c388b3 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:00.371196 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f181c6e4-e622-4756-a64c-02c911c388b3 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:00.371633 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f181c6e4-e622-4756-a64c-02c911c388b3 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:00.536202 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-896bce95-05f4-4b0a-a35a-6b1f858bffbd tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Action: 'create', calling method: .version_select at 0x7f3b9da18a60>, body: {"keypair": {"name": "tempest-keypair-140819421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtPC7NWiyr9RIMfqvtlnA0F4j/zw/5KwpUhmFLJ8as9a10GO/HoxtpfvdvuVrOvoR/u4o5EUXsduu94YhRjDn1VyEq0wQvizXCQubxs3Sv1GbTwlI8yVMxgaiOBwRSU3g=="}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:22:00.553123 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-896bce95-05f4-4b0a-a35a-6b1f858bffbd tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Getting quotas for project 1d2de86d602945238f5df0e2c388004f. Resources: {'key_pairs'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:22:00.562587 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-896bce95-05f4-4b0a-a35a-6b1f858bffbd tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Getting quotas for user dd39ddcf4ab045b98a737ee529a2dcce and project 1d2de86d602945238f5df0e2c388004f. Resources: {'key_pairs'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:22:00.570574 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f181c6e4-e622-4756-a64c-02c911c388b3 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:00.579249 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f181c6e4-e622-4756-a64c-02c911c388b3 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.222039 May 19 12:22:00.579875 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 248/442] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:00 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:00.713329 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-896bce95-05f4-4b0a-a35a-6b1f858bffbd tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.181277 May 19 12:22:00.714270 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 195/443] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 19 12:22:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:22:00.763852 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a0d9f284-0b8b-40c2-a1bb-2c62cbd99e1b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:00.764547 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a0d9f284-0b8b-40c2-a1bb-2c62cbd99e1b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:00.772253 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0d9f284-0b8b-40c2-a1bb-2c62cbd99e1b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:00.772776 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0d9f284-0b8b-40c2-a1bb-2c62cbd99e1b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:00.774825 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0d9f284-0b8b-40c2-a1bb-2c62cbd99e1b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:00.775995 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0d9f284-0b8b-40c2-a1bb-2c62cbd99e1b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:00.853206 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a0d9f284-0b8b-40c2-a1bb-2c62cbd99e1b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:00.862125 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a0d9f284-0b8b-40c2-a1bb-2c62cbd99e1b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1316 microversion: 2.1 time: 0.104111 May 19 12:22:00.866180 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 249/444] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:00 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1316 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:22:01.111610 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e20aa29d-d5a5-409a-a8ad-a49dcc1ef8a6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:01.135452 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e20aa29d-d5a5-409a-a8ad-a49dcc1ef8a6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:01.157675 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e20aa29d-d5a5-409a-a8ad-a49dcc1ef8a6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:01.166198 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e20aa29d-d5a5-409a-a8ad-a49dcc1ef8a6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:01.166198 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e20aa29d-d5a5-409a-a8ad-a49dcc1ef8a6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:01.166198 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e20aa29d-d5a5-409a-a8ad-a49dcc1ef8a6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:01.446459 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e20aa29d-d5a5-409a-a8ad-a49dcc1ef8a6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:01.459241 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e20aa29d-d5a5-409a-a8ad-a49dcc1ef8a6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1710 microversion: 2.1 time: 0.354104 May 19 12:22:01.460336 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 196/445] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:01 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1710 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:01.596672 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7b35bd5f-f772-4fa6-8459-99cb6ad04ba5 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:01.597196 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7b35bd5f-f772-4fa6-8459-99cb6ad04ba5 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:01.611350 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7b35bd5f-f772-4fa6-8459-99cb6ad04ba5 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:01.611828 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7b35bd5f-f772-4fa6-8459-99cb6ad04ba5 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:01.612632 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7b35bd5f-f772-4fa6-8459-99cb6ad04ba5 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:01.613066 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7b35bd5f-f772-4fa6-8459-99cb6ad04ba5 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:01.842978 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7b35bd5f-f772-4fa6-8459-99cb6ad04ba5 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:01.852280 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7b35bd5f-f772-4fa6-8459-99cb6ad04ba5 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.259283 May 19 12:22:01.852795 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 250/446] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:01 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:01.887682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d576981f-e83a-4d17-8741-a47005e95c35 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:01.888572 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d576981f-e83a-4d17-8741-a47005e95c35 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:01.895629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d576981f-e83a-4d17-8741-a47005e95c35 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:01.896126 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d576981f-e83a-4d17-8741-a47005e95c35 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:01.896909 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d576981f-e83a-4d17-8741-a47005e95c35 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:01.897366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d576981f-e83a-4d17-8741-a47005e95c35 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:02.083583 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d576981f-e83a-4d17-8741-a47005e95c35 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:02.098666 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d576981f-e83a-4d17-8741-a47005e95c35 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.215911 May 19 12:22:02.099469 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 197/447] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:01 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:02.377750 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-c8810fd5-1124-4c58-82fb-7cd9cabf3f3b req-7891f76e-8c56-4d2f-8910-d5078a41cfc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9431305d-b1c8-46c1-9625-0d2e0643174e", "name": "network-vif-plugged", "status": "completed", "tag": "d1aaf37f-d3ed-4dc1-91e2-f291ae051dbf"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:22:02.386020 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-c8810fd5-1124-4c58-82fb-7cd9cabf3f3b req-7891f76e-8c56-4d2f-8910-d5078a41cfc1 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:02.386792 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-c8810fd5-1124-4c58-82fb-7cd9cabf3f3b req-7891f76e-8c56-4d2f-8910-d5078a41cfc1 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:02.400042 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-c8810fd5-1124-4c58-82fb-7cd9cabf3f3b req-7891f76e-8c56-4d2f-8910-d5078a41cfc1 service nova] Creating event network-vif-plugged:d1aaf37f-d3ed-4dc1-91e2-f291ae051dbf for instance 9431305d-b1c8-46c1-9625-0d2e0643174e on hv-cinder-80475 May 19 12:22:02.404895 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-c8810fd5-1124-4c58-82fb-7cd9cabf3f3b req-7891f76e-8c56-4d2f-8910-d5078a41cfc1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032075 May 19 12:22:02.405584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 251/448] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:22:02.477548 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-7258966d-1f77-4a65-a2df-671ee1f6cba2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:02.478147 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-7258966d-1f77-4a65-a2df-671ee1f6cba2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:02.484772 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7258966d-1f77-4a65-a2df-671ee1f6cba2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:02.485221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7258966d-1f77-4a65-a2df-671ee1f6cba2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:02.485985 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7258966d-1f77-4a65-a2df-671ee1f6cba2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:02.486413 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7258966d-1f77-4a65-a2df-671ee1f6cba2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:02.657146 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-7258966d-1f77-4a65-a2df-671ee1f6cba2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:02.666793 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-7258966d-1f77-4a65-a2df-671ee1f6cba2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1710 microversion: 2.1 time: 0.193142 May 19 12:22:02.667520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 198/449] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:02 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1710 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:02.871047 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-81edcb93-c39c-47b9-9f1e-b15cde71de33 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:02.872423 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-81edcb93-c39c-47b9-9f1e-b15cde71de33 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:02.879150 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-81edcb93-c39c-47b9-9f1e-b15cde71de33 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:02.879899 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-81edcb93-c39c-47b9-9f1e-b15cde71de33 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:02.880853 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-81edcb93-c39c-47b9-9f1e-b15cde71de33 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:02.881296 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-81edcb93-c39c-47b9-9f1e-b15cde71de33 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:03.106139 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-81edcb93-c39c-47b9-9f1e-b15cde71de33 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:03.114343 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-81edcb93-c39c-47b9-9f1e-b15cde71de33 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.248430 May 19 12:22:03.122850 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0ff11505-9420-4c29-b617-1f6ed190911f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:03.124267 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0ff11505-9420-4c29-b617-1f6ed190911f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:03.128119 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 252/450] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:02 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:03.137869 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0ff11505-9420-4c29-b617-1f6ed190911f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:03.148494 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0ff11505-9420-4c29-b617-1f6ed190911f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:03.150605 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0ff11505-9420-4c29-b617-1f6ed190911f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:03.151761 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0ff11505-9420-4c29-b617-1f6ed190911f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:03.388219 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-0ff11505-9420-4c29-b617-1f6ed190911f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:03.400471 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0ff11505-9420-4c29-b617-1f6ed190911f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.283017 May 19 12:22:03.410290 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 199/451] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:03 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:03.685595 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e3af830c-c985-4fa3-b233-687487bceeb1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:03.686356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e3af830c-c985-4fa3-b233-687487bceeb1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:03.693429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e3af830c-c985-4fa3-b233-687487bceeb1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:03.693885 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e3af830c-c985-4fa3-b233-687487bceeb1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:03.694662 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e3af830c-c985-4fa3-b233-687487bceeb1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:03.695897 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e3af830c-c985-4fa3-b233-687487bceeb1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:03.866118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e3af830c-c985-4fa3-b233-687487bceeb1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:03.877925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e3af830c-c985-4fa3-b233-687487bceeb1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1710 microversion: 2.1 time: 0.196400 May 19 12:22:03.878564 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 253/452] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:03 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1710 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:04.133125 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-609877ae-bb0a-4f14-882a-1ff38f8a1442 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:04.133935 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-609877ae-bb0a-4f14-882a-1ff38f8a1442 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:04.137658 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:04.142091 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-609877ae-bb0a-4f14-882a-1ff38f8a1442 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:04.142541 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-609877ae-bb0a-4f14-882a-1ff38f8a1442 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:04.144590 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-609877ae-bb0a-4f14-882a-1ff38f8a1442 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:04.144590 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-609877ae-bb0a-4f14-882a-1ff38f8a1442 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:04.304776 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-609877ae-bb0a-4f14-882a-1ff38f8a1442 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:04.313426 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-609877ae-bb0a-4f14-882a-1ff38f8a1442 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.184548 May 19 12:22:04.314275 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 200/453] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:04 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:04.419235 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a1e03229-470a-40f9-a25c-a004766f7150 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:04.419923 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a1e03229-470a-40f9-a25c-a004766f7150 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:04.427280 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a1e03229-470a-40f9-a25c-a004766f7150 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:04.427842 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a1e03229-470a-40f9-a25c-a004766f7150 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:04.428522 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a1e03229-470a-40f9-a25c-a004766f7150 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:04.428963 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a1e03229-470a-40f9-a25c-a004766f7150 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:04.593445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a1e03229-470a-40f9-a25c-a004766f7150 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:04.602078 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a1e03229-470a-40f9-a25c-a004766f7150 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.187431 May 19 12:22:04.602679 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 254/454] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:04 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:04.697073 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f9fb5a9e-b64f-4c47-af2d-5d3f79b34590 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2115665956", "imageRef": "962252c6-9c2c-4b81-bdb7-f6d317bada3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "744c5d15-060b-4067-aa62-eecc19d1b85e"}], "security_groups": [{"name": "tempest-securitygroup--1280200401"}], "key_name": "tempest-keypair-140819421", "user_data": "}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:22:04.809388 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.network.neutron [None req-f9fb5a9e-b64f-4c47-af2d-5d3f79b34590 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] validate_networks() for [('744c5d15-060b-4067-aa62-eecc19d1b85e', None, None, None, None, None)] {{(pid=117964) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:22:04.897568 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f881d034-d359-4ec9-a539-af6544ec4c64 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:04.898170 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f881d034-d359-4ec9-a539-af6544ec4c64 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:04.906232 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f881d034-d359-4ec9-a539-af6544ec4c64 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:04.907111 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f881d034-d359-4ec9-a539-af6544ec4c64 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:04.909391 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f881d034-d359-4ec9-a539-af6544ec4c64 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:04.910126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f881d034-d359-4ec9-a539-af6544ec4c64 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:05.195523 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f881d034-d359-4ec9-a539-af6544ec4c64 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:05.195523 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f881d034-d359-4ec9-a539-af6544ec4c64 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1710 microversion: 2.1 time: 0.290334 May 19 12:22:05.195523 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 255/455] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:04 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1710 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:22:05.331352 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d21dfdad-52a4-4998-97a0-9611e404131d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:05.332018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d21dfdad-52a4-4998-97a0-9611e404131d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:05.333124 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-f9fb5a9e-b64f-4c47-af2d-5d3f79b34590 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Flavor limits 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:22:05.333633 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-f9fb5a9e-b64f-4c47-af2d-5d3f79b34590 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Image limits 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:22:05.334043 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-f9fb5a9e-b64f-4c47-af2d-5d3f79b34590 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Flavor pref 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:22:05.334487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-f9fb5a9e-b64f-4c47-af2d-5d3f79b34590 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Image pref 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:22:05.334919 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-f9fb5a9e-b64f-4c47-af2d-5d3f79b34590 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:22:05.338810 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d21dfdad-52a4-4998-97a0-9611e404131d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:05.339291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d21dfdad-52a4-4998-97a0-9611e404131d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:05.340134 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d21dfdad-52a4-4998-97a0-9611e404131d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:05.340579 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d21dfdad-52a4-4998-97a0-9611e404131d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:05.350373 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f9fb5a9e-b64f-4c47-af2d-5d3f79b34590 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:05.351147 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f9fb5a9e-b64f-4c47-af2d-5d3f79b34590 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:05.353095 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f9fb5a9e-b64f-4c47-af2d-5d3f79b34590 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:05.353799 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f9fb5a9e-b64f-4c47-af2d-5d3f79b34590 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:05.382504 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-f9fb5a9e-b64f-4c47-af2d-5d3f79b34590 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Getting quotas for project 1d2de86d602945238f5df0e2c388004f. Resources: {'instances', 'ram', 'cores'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:22:05.388278 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-f9fb5a9e-b64f-4c47-af2d-5d3f79b34590 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Getting quotas for user dd39ddcf4ab045b98a737ee529a2dcce and project 1d2de86d602945238f5df0e2c388004f. Resources: {'instances', 'ram', 'cores'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:22:05.406691 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f9fb5a9e-b64f-4c47-af2d-5d3f79b34590 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Going to run 1 instances... {{(pid=117964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:22:05.409036 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f9fb5a9e-b64f-4c47-af2d-5d3f79b34590 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962252c6-9c2c-4b81-bdb7-f6d317bada3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:22:05.522676 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d21dfdad-52a4-4998-97a0-9611e404131d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:05.536219 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d21dfdad-52a4-4998-97a0-9611e404131d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.209077 May 19 12:22:05.536814 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 256/456] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:05 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:22:05.619328 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-43768d0f-0e7a-4ea4-a457-f2255551e452 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:05.620130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-43768d0f-0e7a-4ea4-a457-f2255551e452 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:05.626458 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-43768d0f-0e7a-4ea4-a457-f2255551e452 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:05.626908 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-43768d0f-0e7a-4ea4-a457-f2255551e452 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:05.627684 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-43768d0f-0e7a-4ea4-a457-f2255551e452 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:05.628161 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-43768d0f-0e7a-4ea4-a457-f2255551e452 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:05.763991 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-43768d0f-0e7a-4ea4-a457-f2255551e452 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:05.771454 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-43768d0f-0e7a-4ea4-a457-f2255551e452 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.156766 May 19 12:22:05.772047 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 257/457] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:05 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:22:06.202556 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1d89aa25-80a3-49af-afe0-2e4d36edcbb5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:06.204010 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1d89aa25-80a3-49af-afe0-2e4d36edcbb5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:06.206261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:06.224366 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1d89aa25-80a3-49af-afe0-2e4d36edcbb5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:06.225771 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1d89aa25-80a3-49af-afe0-2e4d36edcbb5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:06.231076 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1d89aa25-80a3-49af-afe0-2e4d36edcbb5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:06.231563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1d89aa25-80a3-49af-afe0-2e4d36edcbb5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:06.239524 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f9fb5a9e-b64f-4c47-af2d-5d3f79b34590 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.547810 May 19 12:22:06.240509 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 201/458] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:22:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:22:06.269242 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-79d2e3b4-2685-455f-87ba-d3cd6691e510 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:06.269242 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-79d2e3b4-2685-455f-87ba-d3cd6691e510 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:06.413806 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-79d2e3b4-2685-455f-87ba-d3cd6691e510 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:06.422172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-79d2e3b4-2685-455f-87ba-d3cd6691e510 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1241 microversion: 2.1 time: 0.174288 May 19 12:22:06.428615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 202/459] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:06 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1241 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:06.498555 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1d89aa25-80a3-49af-afe0-2e4d36edcbb5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:06.515071 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1d89aa25-80a3-49af-afe0-2e4d36edcbb5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1710 microversion: 2.1 time: 0.315409 May 19 12:22:06.515770 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 258/460] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:06 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1710 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:22:06.554116 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-93670feb-ece6-4135-b60f-dd308c59fd7f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:06.554808 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-93670feb-ece6-4135-b60f-dd308c59fd7f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:06.562255 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-93670feb-ece6-4135-b60f-dd308c59fd7f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:06.563552 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-93670feb-ece6-4135-b60f-dd308c59fd7f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:06.564117 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-93670feb-ece6-4135-b60f-dd308c59fd7f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:06.565158 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-93670feb-ece6-4135-b60f-dd308c59fd7f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:06.722666 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-93670feb-ece6-4135-b60f-dd308c59fd7f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:06.731768 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-93670feb-ece6-4135-b60f-dd308c59fd7f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.181481 May 19 12:22:06.732307 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 203/461] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:06 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:06.789629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-30ed62ae-71a9-407d-bb84-27b5d46191c9 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:06.790629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-30ed62ae-71a9-407d-bb84-27b5d46191c9 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:06.796763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-30ed62ae-71a9-407d-bb84-27b5d46191c9 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:06.797209 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-30ed62ae-71a9-407d-bb84-27b5d46191c9 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:06.797971 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-30ed62ae-71a9-407d-bb84-27b5d46191c9 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:06.798409 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-30ed62ae-71a9-407d-bb84-27b5d46191c9 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:06.963060 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-30ed62ae-71a9-407d-bb84-27b5d46191c9 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:06.975907 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-30ed62ae-71a9-407d-bb84-27b5d46191c9 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.190552 May 19 12:22:06.977665 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 259/462] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:06 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:07.441859 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f274295e-d043-43f0-90c6-d12f5366f188 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:07.442493 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f274295e-d043-43f0-90c6-d12f5366f188 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:07.450403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f274295e-d043-43f0-90c6-d12f5366f188 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:07.450853 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f274295e-d043-43f0-90c6-d12f5366f188 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:07.451626 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f274295e-d043-43f0-90c6-d12f5366f188 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:07.452293 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f274295e-d043-43f0-90c6-d12f5366f188 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:07.521904 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f274295e-d043-43f0-90c6-d12f5366f188 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:07.530958 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f274295e-d043-43f0-90c6-d12f5366f188 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1245 microversion: 2.1 time: 0.093414 May 19 12:22:07.538327 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 204/463] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:07 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:22:07.538477 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ac11fbb0-e4eb-4a9f-b120-6923dde96ea1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:07.538477 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ac11fbb0-e4eb-4a9f-b120-6923dde96ea1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:07.541169 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ac11fbb0-e4eb-4a9f-b120-6923dde96ea1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:07.541884 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ac11fbb0-e4eb-4a9f-b120-6923dde96ea1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:07.542663 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ac11fbb0-e4eb-4a9f-b120-6923dde96ea1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:07.543091 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ac11fbb0-e4eb-4a9f-b120-6923dde96ea1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:07.543534 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=8 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:07.564969 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:07.690289 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ac11fbb0-e4eb-4a9f-b120-6923dde96ea1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:07.699266 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ac11fbb0-e4eb-4a9f-b120-6923dde96ea1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1710 microversion: 2.1 time: 0.169981 May 19 12:22:07.700099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 260/464] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:07 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1710 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:22:07.748844 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e95db799-6165-4d06-9c10-10f225c394ba tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:07.749452 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e95db799-6165-4d06-9c10-10f225c394ba tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:07.755922 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e95db799-6165-4d06-9c10-10f225c394ba tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:07.756410 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e95db799-6165-4d06-9c10-10f225c394ba tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:07.757159 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e95db799-6165-4d06-9c10-10f225c394ba tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:07.757596 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e95db799-6165-4d06-9c10-10f225c394ba tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:07.913506 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e95db799-6165-4d06-9c10-10f225c394ba tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:07.915331 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e95db799-6165-4d06-9c10-10f225c394ba tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.170322 May 19 12:22:07.915977 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 205/465] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:07 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:08.000454 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b95e328d-029c-427d-9fda-d983eea08442 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:08.001104 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b95e328d-029c-427d-9fda-d983eea08442 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:08.007520 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b95e328d-029c-427d-9fda-d983eea08442 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:08.008866 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b95e328d-029c-427d-9fda-d983eea08442 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:08.010090 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b95e328d-029c-427d-9fda-d983eea08442 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:08.010578 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b95e328d-029c-427d-9fda-d983eea08442 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:08.154865 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b95e328d-029c-427d-9fda-d983eea08442 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:08.163686 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b95e328d-029c-427d-9fda-d983eea08442 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.167830 May 19 12:22:08.165287 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 261/466] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:07 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:22:08.549648 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-becf804b-f9ff-45ba-913c-729ebd807f18 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:08.550831 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-becf804b-f9ff-45ba-913c-729ebd807f18 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:08.558232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-becf804b-f9ff-45ba-913c-729ebd807f18 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:08.558834 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-becf804b-f9ff-45ba-913c-729ebd807f18 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:08.559704 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-becf804b-f9ff-45ba-913c-729ebd807f18 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:08.560630 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-becf804b-f9ff-45ba-913c-729ebd807f18 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:08.629718 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-becf804b-f9ff-45ba-913c-729ebd807f18 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:08.637639 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-becf804b-f9ff-45ba-913c-729ebd807f18 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1245 microversion: 2.1 time: 0.092015 May 19 12:22:08.638282 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 206/467] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:08 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:08.719213 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c2e82d43-f406-4b88-bde6-9d7df4391326 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:08.720524 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c2e82d43-f406-4b88-bde6-9d7df4391326 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:08.728551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c2e82d43-f406-4b88-bde6-9d7df4391326 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:08.729001 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c2e82d43-f406-4b88-bde6-9d7df4391326 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:08.729780 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c2e82d43-f406-4b88-bde6-9d7df4391326 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:08.730294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c2e82d43-f406-4b88-bde6-9d7df4391326 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:08.872403 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c2e82d43-f406-4b88-bde6-9d7df4391326 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:08.880809 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c2e82d43-f406-4b88-bde6-9d7df4391326 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1710 microversion: 2.1 time: 0.166551 May 19 12:22:08.881838 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 262/468] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:08 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1710 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:08.932202 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5da79654-9aef-4bc1-9bf9-ef9f5a7d74d1 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:08.932855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5da79654-9aef-4bc1-9bf9-ef9f5a7d74d1 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:08.939273 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5da79654-9aef-4bc1-9bf9-ef9f5a7d74d1 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:08.939717 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5da79654-9aef-4bc1-9bf9-ef9f5a7d74d1 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:08.940532 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5da79654-9aef-4bc1-9bf9-ef9f5a7d74d1 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:08.940972 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5da79654-9aef-4bc1-9bf9-ef9f5a7d74d1 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:09.091526 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5da79654-9aef-4bc1-9bf9-ef9f5a7d74d1 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:09.099394 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5da79654-9aef-4bc1-9bf9-ef9f5a7d74d1 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.171434 May 19 12:22:09.100000 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 207/469] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:08 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:09.182776 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a0da47c4-d59d-4963-a81f-83bf94c38f6a tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:09.183391 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a0da47c4-d59d-4963-a81f-83bf94c38f6a tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:09.189818 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0da47c4-d59d-4963-a81f-83bf94c38f6a tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:09.190261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0da47c4-d59d-4963-a81f-83bf94c38f6a tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:09.191495 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0da47c4-d59d-4963-a81f-83bf94c38f6a tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:09.192319 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0da47c4-d59d-4963-a81f-83bf94c38f6a tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:09.340230 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a0da47c4-d59d-4963-a81f-83bf94c38f6a tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:09.349179 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a0da47c4-d59d-4963-a81f-83bf94c38f6a tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.170451 May 19 12:22:09.359158 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 263/470] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:09 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:09.654849 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-761c98e2-6f07-4847-8802-73c4ffe24d4b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:09.655500 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-761c98e2-6f07-4847-8802-73c4ffe24d4b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:09.661995 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-761c98e2-6f07-4847-8802-73c4ffe24d4b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:09.662444 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-761c98e2-6f07-4847-8802-73c4ffe24d4b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:09.663224 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-761c98e2-6f07-4847-8802-73c4ffe24d4b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:09.663662 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-761c98e2-6f07-4847-8802-73c4ffe24d4b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:09.743930 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-761c98e2-6f07-4847-8802-73c4ffe24d4b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:09.744234 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-761c98e2-6f07-4847-8802-73c4ffe24d4b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1245 microversion: 2.1 time: 0.093240 May 19 12:22:09.744799 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 208/471] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:09 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:09.898592 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ee19f60f-64ab-4773-96d9-278acf02de72 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:09.899406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ee19f60f-64ab-4773-96d9-278acf02de72 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:09.906298 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ee19f60f-64ab-4773-96d9-278acf02de72 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:09.906696 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ee19f60f-64ab-4773-96d9-278acf02de72 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:09.907474 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ee19f60f-64ab-4773-96d9-278acf02de72 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:09.907946 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ee19f60f-64ab-4773-96d9-278acf02de72 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:10.056447 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ee19f60f-64ab-4773-96d9-278acf02de72 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:10.064852 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ee19f60f-64ab-4773-96d9-278acf02de72 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1710 microversion: 2.1 time: 0.170211 May 19 12:22:10.065631 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 264/472] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:09 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1710 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:10.116914 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ed54468f-ea8d-49d6-a087-d5262d21fc46 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:10.117802 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ed54468f-ea8d-49d6-a087-d5262d21fc46 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:10.124036 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ed54468f-ea8d-49d6-a087-d5262d21fc46 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:10.124490 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ed54468f-ea8d-49d6-a087-d5262d21fc46 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:10.125262 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ed54468f-ea8d-49d6-a087-d5262d21fc46 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:10.125701 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ed54468f-ea8d-49d6-a087-d5262d21fc46 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:10.265244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ed54468f-ea8d-49d6-a087-d5262d21fc46 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:10.272523 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ed54468f-ea8d-49d6-a087-d5262d21fc46 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.159439 May 19 12:22:10.279080 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 209/473] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:10 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:10.366803 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-176a01ef-23bd-4902-b02e-5f504425157f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:10.367439 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-176a01ef-23bd-4902-b02e-5f504425157f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:10.373911 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-176a01ef-23bd-4902-b02e-5f504425157f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:10.374355 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-176a01ef-23bd-4902-b02e-5f504425157f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:10.375109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-176a01ef-23bd-4902-b02e-5f504425157f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:10.375539 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-176a01ef-23bd-4902-b02e-5f504425157f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:10.522706 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-176a01ef-23bd-4902-b02e-5f504425157f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:10.531155 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-176a01ef-23bd-4902-b02e-5f504425157f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.168189 May 19 12:22:10.531735 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 265/474] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:10 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:10.763189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-44f81f6e-c3c9-48e1-b511-994e45bb1e0e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:10.763769 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-44f81f6e-c3c9-48e1-b511-994e45bb1e0e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:10.769835 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-44f81f6e-c3c9-48e1-b511-994e45bb1e0e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:10.770290 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-44f81f6e-c3c9-48e1-b511-994e45bb1e0e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:10.771082 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-44f81f6e-c3c9-48e1-b511-994e45bb1e0e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:10.771525 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-44f81f6e-c3c9-48e1-b511-994e45bb1e0e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:10.836531 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-44f81f6e-c3c9-48e1-b511-994e45bb1e0e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:10.843917 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-44f81f6e-c3c9-48e1-b511-994e45bb1e0e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1245 microversion: 2.1 time: 0.085245 May 19 12:22:10.844481 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 210/475] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:10 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:11.086645 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1533ade4-942e-4b5c-a4dc-ee54eab54381 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:11.087436 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1533ade4-942e-4b5c-a4dc-ee54eab54381 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:11.090284 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:11.095245 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1533ade4-942e-4b5c-a4dc-ee54eab54381 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:11.101773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1533ade4-942e-4b5c-a4dc-ee54eab54381 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:11.101773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1533ade4-942e-4b5c-a4dc-ee54eab54381 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:11.101773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1533ade4-942e-4b5c-a4dc-ee54eab54381 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:11.256797 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1533ade4-942e-4b5c-a4dc-ee54eab54381 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:11.265370 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1533ade4-942e-4b5c-a4dc-ee54eab54381 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1710 microversion: 2.1 time: 0.186589 May 19 12:22:11.270175 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 266/476] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:11 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1710 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:11.291215 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-995896d5-a00c-4d4e-886b-9dfdeb2aae87 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:11.292011 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-995896d5-a00c-4d4e-886b-9dfdeb2aae87 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:11.299228 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-995896d5-a00c-4d4e-886b-9dfdeb2aae87 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:11.299977 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-995896d5-a00c-4d4e-886b-9dfdeb2aae87 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:11.301233 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-995896d5-a00c-4d4e-886b-9dfdeb2aae87 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:11.301935 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-995896d5-a00c-4d4e-886b-9dfdeb2aae87 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:11.307039 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=100 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:11.459938 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-995896d5-a00c-4d4e-886b-9dfdeb2aae87 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:11.468549 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-995896d5-a00c-4d4e-886b-9dfdeb2aae87 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.182371 May 19 12:22:11.469117 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 211/477] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:11 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:11.549931 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a38953a7-2de9-41f5-99c6-fa8450e78657 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:11.550535 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a38953a7-2de9-41f5-99c6-fa8450e78657 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:11.557500 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a38953a7-2de9-41f5-99c6-fa8450e78657 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:11.557941 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a38953a7-2de9-41f5-99c6-fa8450e78657 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:11.558693 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a38953a7-2de9-41f5-99c6-fa8450e78657 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:11.559124 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a38953a7-2de9-41f5-99c6-fa8450e78657 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:11.701489 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a38953a7-2de9-41f5-99c6-fa8450e78657 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:11.710494 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a38953a7-2de9-41f5-99c6-fa8450e78657 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.164300 May 19 12:22:11.711263 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 267/478] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:11 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:11.864292 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ad6d53af-908e-4ab2-b48c-e1c8893a9bb0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:11.865009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ad6d53af-908e-4ab2-b48c-e1c8893a9bb0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:11.873459 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ad6d53af-908e-4ab2-b48c-e1c8893a9bb0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:11.873964 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ad6d53af-908e-4ab2-b48c-e1c8893a9bb0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:11.874815 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ad6d53af-908e-4ab2-b48c-e1c8893a9bb0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:11.875367 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ad6d53af-908e-4ab2-b48c-e1c8893a9bb0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:11.953973 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ad6d53af-908e-4ab2-b48c-e1c8893a9bb0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:11.963553 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ad6d53af-908e-4ab2-b48c-e1c8893a9bb0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1245 microversion: 2.1 time: 0.104179 May 19 12:22:11.964167 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 212/479] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:11 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:12.282872 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-916c6c81-7943-48dc-b3ad-9658d3a19692 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:12.283495 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-916c6c81-7943-48dc-b3ad-9658d3a19692 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:12.290509 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-916c6c81-7943-48dc-b3ad-9658d3a19692 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:12.290970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-916c6c81-7943-48dc-b3ad-9658d3a19692 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:12.291765 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-916c6c81-7943-48dc-b3ad-9658d3a19692 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:12.292377 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-916c6c81-7943-48dc-b3ad-9658d3a19692 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:12.428317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-916c6c81-7943-48dc-b3ad-9658d3a19692 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:12.437234 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-916c6c81-7943-48dc-b3ad-9658d3a19692 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1710 microversion: 2.1 time: 0.158551 May 19 12:22:12.442240 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 268/480] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:12 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1710 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:12.486938 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-948f2bd8-6aaf-47c7-87e9-de26edb051ce tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:12.487607 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-948f2bd8-6aaf-47c7-87e9-de26edb051ce tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:12.494492 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-948f2bd8-6aaf-47c7-87e9-de26edb051ce tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:12.494932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-948f2bd8-6aaf-47c7-87e9-de26edb051ce tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:12.496907 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-948f2bd8-6aaf-47c7-87e9-de26edb051ce tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:12.496907 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-948f2bd8-6aaf-47c7-87e9-de26edb051ce tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:12.633551 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-948f2bd8-6aaf-47c7-87e9-de26edb051ce tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:12.641968 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-948f2bd8-6aaf-47c7-87e9-de26edb051ce tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.159310 May 19 12:22:12.642529 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 213/481] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:12 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:22:12.728440 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ae07746f-36cc-4f39-909f-e75728cd56e8 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:12.729054 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ae07746f-36cc-4f39-909f-e75728cd56e8 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:12.735599 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae07746f-36cc-4f39-909f-e75728cd56e8 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:12.736073 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae07746f-36cc-4f39-909f-e75728cd56e8 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:12.736913 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae07746f-36cc-4f39-909f-e75728cd56e8 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:12.737353 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae07746f-36cc-4f39-909f-e75728cd56e8 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:12.871414 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ae07746f-36cc-4f39-909f-e75728cd56e8 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:12.878900 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ae07746f-36cc-4f39-909f-e75728cd56e8 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.155029 May 19 12:22:12.879460 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 269/482] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:12 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:12.980790 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f7bcabdb-3e2d-4719-b11f-bb0603b813c8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:12.981413 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f7bcabdb-3e2d-4719-b11f-bb0603b813c8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:12.988183 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f7bcabdb-3e2d-4719-b11f-bb0603b813c8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:12.988624 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f7bcabdb-3e2d-4719-b11f-bb0603b813c8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:12.989380 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f7bcabdb-3e2d-4719-b11f-bb0603b813c8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:12.989858 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f7bcabdb-3e2d-4719-b11f-bb0603b813c8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:13.050676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f7bcabdb-3e2d-4719-b11f-bb0603b813c8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:13.058557 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f7bcabdb-3e2d-4719-b11f-bb0603b813c8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1245 microversion: 2.1 time: 0.082138 May 19 12:22:13.059116 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 214/483] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:12 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:13.456212 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-72b674d6-d164-4c79-a81f-4f55cbedb489 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:13.456815 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-72b674d6-d164-4c79-a81f-4f55cbedb489 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:13.464315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-72b674d6-d164-4c79-a81f-4f55cbedb489 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:13.464756 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-72b674d6-d164-4c79-a81f-4f55cbedb489 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:13.465522 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-72b674d6-d164-4c79-a81f-4f55cbedb489 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:13.465956 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-72b674d6-d164-4c79-a81f-4f55cbedb489 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:13.596232 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-72b674d6-d164-4c79-a81f-4f55cbedb489 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:13.606565 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-72b674d6-d164-4c79-a81f-4f55cbedb489 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1710 microversion: 2.1 time: 0.154309 May 19 12:22:13.607179 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 270/484] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:13 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1710 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:13.658902 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-bd216f38-58b3-4486-a3a7-164a96efea63 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:13.659546 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-bd216f38-58b3-4486-a3a7-164a96efea63 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:13.666057 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bd216f38-58b3-4486-a3a7-164a96efea63 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:13.666502 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bd216f38-58b3-4486-a3a7-164a96efea63 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:13.667270 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bd216f38-58b3-4486-a3a7-164a96efea63 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:13.667706 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bd216f38-58b3-4486-a3a7-164a96efea63 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:13.803213 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-bd216f38-58b3-4486-a3a7-164a96efea63 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:13.811407 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-bd216f38-58b3-4486-a3a7-164a96efea63 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.156344 May 19 12:22:13.812005 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 215/485] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:13 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:13.895352 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-05ef3f56-e8b3-490d-8efa-73552427ea87 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:13.895984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-05ef3f56-e8b3-490d-8efa-73552427ea87 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:13.902801 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-05ef3f56-e8b3-490d-8efa-73552427ea87 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:13.903251 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-05ef3f56-e8b3-490d-8efa-73552427ea87 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:13.904050 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-05ef3f56-e8b3-490d-8efa-73552427ea87 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:13.904485 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-05ef3f56-e8b3-490d-8efa-73552427ea87 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:14.041772 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-05ef3f56-e8b3-490d-8efa-73552427ea87 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:14.049492 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-05ef3f56-e8b3-490d-8efa-73552427ea87 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.158005 May 19 12:22:14.050076 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 271/486] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:13 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:14.075534 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9622e74e-d55d-484d-85fc-cded1bf6d324 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:14.076168 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9622e74e-d55d-484d-85fc-cded1bf6d324 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:14.082746 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9622e74e-d55d-484d-85fc-cded1bf6d324 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:14.083196 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9622e74e-d55d-484d-85fc-cded1bf6d324 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:14.084000 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9622e74e-d55d-484d-85fc-cded1bf6d324 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:14.084438 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9622e74e-d55d-484d-85fc-cded1bf6d324 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:14.152869 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9622e74e-d55d-484d-85fc-cded1bf6d324 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:14.160966 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9622e74e-d55d-484d-85fc-cded1bf6d324 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1245 microversion: 2.1 time: 0.090382 May 19 12:22:14.163590 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 216/487] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:14 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:14.626345 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c570b874-0df9-4066-ad27-95eb9e9fb630 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:14.626937 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c570b874-0df9-4066-ad27-95eb9e9fb630 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:14.633693 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c570b874-0df9-4066-ad27-95eb9e9fb630 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:14.634494 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c570b874-0df9-4066-ad27-95eb9e9fb630 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:14.635343 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c570b874-0df9-4066-ad27-95eb9e9fb630 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:14.635804 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c570b874-0df9-4066-ad27-95eb9e9fb630 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:14.772654 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c570b874-0df9-4066-ad27-95eb9e9fb630 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:14.781406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c570b874-0df9-4066-ad27-95eb9e9fb630 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1710 microversion: 2.1 time: 0.160476 May 19 12:22:14.799595 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 272/488] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:14 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1710 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:14.829264 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-4837515a-743a-4db4-98d2-5e5ce5634261 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:14.829872 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-4837515a-743a-4db4-98d2-5e5ce5634261 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:14.836614 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4837515a-743a-4db4-98d2-5e5ce5634261 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:14.837096 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4837515a-743a-4db4-98d2-5e5ce5634261 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:14.837870 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4837515a-743a-4db4-98d2-5e5ce5634261 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:14.838305 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4837515a-743a-4db4-98d2-5e5ce5634261 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:14.975557 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-4837515a-743a-4db4-98d2-5e5ce5634261 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:14.983522 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-4837515a-743a-4db4-98d2-5e5ce5634261 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.158172 May 19 12:22:14.984126 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 217/489] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:14 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:15.067046 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e8a88f74-3bd7-4223-b644-07a22cbeb537 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:15.067647 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e8a88f74-3bd7-4223-b644-07a22cbeb537 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:15.074268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e8a88f74-3bd7-4223-b644-07a22cbeb537 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:15.074712 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e8a88f74-3bd7-4223-b644-07a22cbeb537 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:15.075461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e8a88f74-3bd7-4223-b644-07a22cbeb537 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:15.075935 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e8a88f74-3bd7-4223-b644-07a22cbeb537 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:15.179055 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ee93e0b5-9656-48c6-a7dd-9430c56cb4bb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:15.179587 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ee93e0b5-9656-48c6-a7dd-9430c56cb4bb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:15.186866 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ee93e0b5-9656-48c6-a7dd-9430c56cb4bb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:15.188034 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ee93e0b5-9656-48c6-a7dd-9430c56cb4bb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:15.188162 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ee93e0b5-9656-48c6-a7dd-9430c56cb4bb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:15.188577 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ee93e0b5-9656-48c6-a7dd-9430c56cb4bb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:15.218285 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e8a88f74-3bd7-4223-b644-07a22cbeb537 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:15.226332 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e8a88f74-3bd7-4223-b644-07a22cbeb537 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.162851 May 19 12:22:15.227385 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 273/490] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:15 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:15.255657 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ee93e0b5-9656-48c6-a7dd-9430c56cb4bb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:15.264670 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ee93e0b5-9656-48c6-a7dd-9430c56cb4bb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1245 microversion: 2.1 time: 0.089837 May 19 12:22:15.265286 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 218/491] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:15 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:22:15.798675 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a8099c3f-7cfe-4d78-8ace-e732e50f8acb tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:15.799286 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a8099c3f-7cfe-4d78-8ace-e732e50f8acb tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:15.806581 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a8099c3f-7cfe-4d78-8ace-e732e50f8acb tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:15.807034 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a8099c3f-7cfe-4d78-8ace-e732e50f8acb tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:15.807837 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a8099c3f-7cfe-4d78-8ace-e732e50f8acb tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:15.808276 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a8099c3f-7cfe-4d78-8ace-e732e50f8acb tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:15.959917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a8099c3f-7cfe-4d78-8ace-e732e50f8acb tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:15.972524 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a8099c3f-7cfe-4d78-8ace-e732e50f8acb tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1710 microversion: 2.1 time: 0.177740 May 19 12:22:15.973673 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 274/492] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:15 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1710 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:16.003887 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f0c03104-6a70-4738-badc-f28fd73447ff tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:16.003887 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f0c03104-6a70-4738-badc-f28fd73447ff tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:16.005114 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=2 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:16.010756 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f0c03104-6a70-4738-badc-f28fd73447ff tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:16.011227 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f0c03104-6a70-4738-badc-f28fd73447ff tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:16.012032 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f0c03104-6a70-4738-badc-f28fd73447ff tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:16.012472 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f0c03104-6a70-4738-badc-f28fd73447ff tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:16.181401 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f0c03104-6a70-4738-badc-f28fd73447ff tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:16.191480 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f0c03104-6a70-4738-badc-f28fd73447ff tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.194022 May 19 12:22:16.192200 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 219/493] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:15 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:16.243806 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e7aba991-a483-4cc4-b8bc-3740fca38074 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:16.244354 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e7aba991-a483-4cc4-b8bc-3740fca38074 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:16.252114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e7aba991-a483-4cc4-b8bc-3740fca38074 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:16.252746 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e7aba991-a483-4cc4-b8bc-3740fca38074 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:16.253510 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e7aba991-a483-4cc4-b8bc-3740fca38074 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:16.253947 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e7aba991-a483-4cc4-b8bc-3740fca38074 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:16.261285 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-0a1c2eeb-da01-4fa8-8887-425bd8cbd954 req-f49a642b-14bc-4529-9c5e-5d7fe9469921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7da8d619-7d0b-4cfe-bf0b-f42f7d304db3", "tag": "e5cc5a87-b36f-4dee-a908-9a890b9f1ed7"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:22:16.270841 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-0a1c2eeb-da01-4fa8-8887-425bd8cbd954 req-f49a642b-14bc-4529-9c5e-5d7fe9469921 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:16.271392 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-0a1c2eeb-da01-4fa8-8887-425bd8cbd954 req-f49a642b-14bc-4529-9c5e-5d7fe9469921 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:16.287449 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-0a1c2eeb-da01-4fa8-8887-425bd8cbd954 req-f49a642b-14bc-4529-9c5e-5d7fe9469921 service nova] Creating event network-changed:e5cc5a87-b36f-4dee-a908-9a890b9f1ed7 for instance 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 on hv-cinder-80475 May 19 12:22:16.294793 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-0a1c2eeb-da01-4fa8-8887-425bd8cbd954 req-f49a642b-14bc-4529-9c5e-5d7fe9469921 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038443 May 19 12:22:16.295994 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 220/494] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:22:16.301434 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f4ff6926-a216-4904-811b-83456fe46042 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:16.302136 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f4ff6926-a216-4904-811b-83456fe46042 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:16.309709 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f4ff6926-a216-4904-811b-83456fe46042 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:16.317154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f4ff6926-a216-4904-811b-83456fe46042 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:16.317154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f4ff6926-a216-4904-811b-83456fe46042 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:16.317154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f4ff6926-a216-4904-811b-83456fe46042 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:16.386440 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f4ff6926-a216-4904-811b-83456fe46042 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:16.394888 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f4ff6926-a216-4904-811b-83456fe46042 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1237 microversion: 2.1 time: 0.097567 May 19 12:22:16.395653 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 221/495] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:16 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1237 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:16.426946 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e7aba991-a483-4cc4-b8bc-3740fca38074 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:16.444969 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e7aba991-a483-4cc4-b8bc-3740fca38074 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.205511 May 19 12:22:16.446160 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 275/496] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:16 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:16.991409 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0a812628-caf6-4dfe-9152-0db18ded381e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:16.992728 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0a812628-caf6-4dfe-9152-0db18ded381e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:16.995299 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=18 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:17.000639 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0a812628-caf6-4dfe-9152-0db18ded381e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:17.001091 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0a812628-caf6-4dfe-9152-0db18ded381e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:17.001868 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0a812628-caf6-4dfe-9152-0db18ded381e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:17.002301 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0a812628-caf6-4dfe-9152-0db18ded381e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:17.138334 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-0a812628-caf6-4dfe-9152-0db18ded381e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:17.146325 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0a812628-caf6-4dfe-9152-0db18ded381e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1714 microversion: 2.1 time: 0.158799 May 19 12:22:17.146885 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 222/497] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:16 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1714 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:17.209054 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6a06c4ff-66b3-4970-80a1-131542ee55d9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:17.209662 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6a06c4ff-66b3-4970-80a1-131542ee55d9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:17.216592 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a06c4ff-66b3-4970-80a1-131542ee55d9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:17.217037 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a06c4ff-66b3-4970-80a1-131542ee55d9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:17.217804 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a06c4ff-66b3-4970-80a1-131542ee55d9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:17.218236 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a06c4ff-66b3-4970-80a1-131542ee55d9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:17.357802 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6a06c4ff-66b3-4970-80a1-131542ee55d9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:17.366277 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6a06c4ff-66b3-4970-80a1-131542ee55d9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1260 microversion: 2.1 time: 0.160838 May 19 12:22:17.366871 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 276/498] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:17 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:17.419551 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-2d2d8956-f7c1-49fe-a552-b83f5b12fb1e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:17.420185 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-2d2d8956-f7c1-49fe-a552-b83f5b12fb1e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:17.427072 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2d2d8956-f7c1-49fe-a552-b83f5b12fb1e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:17.427526 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2d2d8956-f7c1-49fe-a552-b83f5b12fb1e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:17.428408 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2d2d8956-f7c1-49fe-a552-b83f5b12fb1e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:17.428917 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2d2d8956-f7c1-49fe-a552-b83f5b12fb1e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:17.476048 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e40d930b-a4ee-4310-b969-5cebfd443fd1 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:17.478143 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e40d930b-a4ee-4310-b969-5cebfd443fd1 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:17.500792 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e40d930b-a4ee-4310-b969-5cebfd443fd1 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:17.501242 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e40d930b-a4ee-4310-b969-5cebfd443fd1 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:17.502027 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e40d930b-a4ee-4310-b969-5cebfd443fd1 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:17.502461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e40d930b-a4ee-4310-b969-5cebfd443fd1 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:17.502759 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-2d2d8956-f7c1-49fe-a552-b83f5b12fb1e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:17.506856 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:17.511085 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-2d2d8956-f7c1-49fe-a552-b83f5b12fb1e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1237 microversion: 2.1 time: 0.095612 May 19 12:22:17.511710 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 223/499] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:17 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1237 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:17.637343 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e40d930b-a4ee-4310-b969-5cebfd443fd1 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:17.644958 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e40d930b-a4ee-4310-b969-5cebfd443fd1 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.186199 May 19 12:22:17.645522 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 277/500] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:17 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:22:18.384268 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9c2a5819-e908-476a-ae67-1e8de21b449f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:18.384883 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9c2a5819-e908-476a-ae67-1e8de21b449f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:18.391386 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9c2a5819-e908-476a-ae67-1e8de21b449f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:18.391871 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9c2a5819-e908-476a-ae67-1e8de21b449f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:18.392649 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9c2a5819-e908-476a-ae67-1e8de21b449f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:18.393086 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9c2a5819-e908-476a-ae67-1e8de21b449f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:18.528641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fee70850-a288-4853-8eac-e0c87cd2cfc4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:18.530022 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-fee70850-a288-4853-8eac-e0c87cd2cfc4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:18.531518 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9c2a5819-e908-476a-ae67-1e8de21b449f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:18.537000 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fee70850-a288-4853-8eac-e0c87cd2cfc4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:18.537696 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fee70850-a288-4853-8eac-e0c87cd2cfc4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:18.538649 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fee70850-a288-4853-8eac-e0c87cd2cfc4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:18.539266 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fee70850-a288-4853-8eac-e0c87cd2cfc4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:18.540804 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9c2a5819-e908-476a-ae67-1e8de21b449f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1444 microversion: 2.1 time: 0.161286 May 19 12:22:18.541391 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 224/501] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:18 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:18.559326 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6b25e298-90b6-45e4-badb-b7ad9ba82ded tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:18.564483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6b25e298-90b6-45e4-badb-b7ad9ba82ded tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:18.566468 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6b25e298-90b6-45e4-badb-b7ad9ba82ded tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:18.566986 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6b25e298-90b6-45e4-badb-b7ad9ba82ded tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:18.568138 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6b25e298-90b6-45e4-badb-b7ad9ba82ded tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:18.568762 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6b25e298-90b6-45e4-badb-b7ad9ba82ded tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:18.620121 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fee70850-a288-4853-8eac-e0c87cd2cfc4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:18.627903 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fee70850-a288-4853-8eac-e0c87cd2cfc4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1293 microversion: 2.1 time: 0.103419 May 19 12:22:18.628498 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 278/502] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:18 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1293 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:22:18.666447 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-09acdec4-946b-4d7f-87ff-2341f6be4ef0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:18.667115 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-09acdec4-946b-4d7f-87ff-2341f6be4ef0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:18.673748 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-09acdec4-946b-4d7f-87ff-2341f6be4ef0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:18.674193 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-09acdec4-946b-4d7f-87ff-2341f6be4ef0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:18.675027 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-09acdec4-946b-4d7f-87ff-2341f6be4ef0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:18.675457 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-09acdec4-946b-4d7f-87ff-2341f6be4ef0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:18.737859 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6b25e298-90b6-45e4-badb-b7ad9ba82ded tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:18.747440 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6b25e298-90b6-45e4-badb-b7ad9ba82ded tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1444 microversion: 2.1 time: 0.193339 May 19 12:22:18.748198 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 225/503] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:18 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1444 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:18.837562 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-09acdec4-946b-4d7f-87ff-2341f6be4ef0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:18.846649 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-09acdec4-946b-4d7f-87ff-2341f6be4ef0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.187853 May 19 12:22:18.856947 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 279/504] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:18 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:22:19.646095 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6be3e91b-871b-42de-9f8f-631edf0edcf9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:19.646705 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6be3e91b-871b-42de-9f8f-631edf0edcf9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:19.654371 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6be3e91b-871b-42de-9f8f-631edf0edcf9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:19.655019 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6be3e91b-871b-42de-9f8f-631edf0edcf9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:19.655826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6be3e91b-871b-42de-9f8f-631edf0edcf9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:19.656300 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6be3e91b-871b-42de-9f8f-631edf0edcf9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:19.723581 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6be3e91b-871b-42de-9f8f-631edf0edcf9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:19.733763 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6be3e91b-871b-42de-9f8f-631edf0edcf9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1299 microversion: 2.1 time: 0.091954 May 19 12:22:19.734349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 226/505] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:19 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:19.864967 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-89a4321e-7c6e-453c-afee-4f2203c74e3b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:19.865819 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-89a4321e-7c6e-453c-afee-4f2203c74e3b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:19.873035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-89a4321e-7c6e-453c-afee-4f2203c74e3b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:19.873759 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-89a4321e-7c6e-453c-afee-4f2203c74e3b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:19.874649 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-89a4321e-7c6e-453c-afee-4f2203c74e3b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:19.875368 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-89a4321e-7c6e-453c-afee-4f2203c74e3b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:20.121757 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-89a4321e-7c6e-453c-afee-4f2203c74e3b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:20.130597 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-89a4321e-7c6e-453c-afee-4f2203c74e3b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.269285 May 19 12:22:20.141798 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 280/506] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:19 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:20.753382 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-3631fbe6-91c9-45e5-9846-e0c8e1cba0eb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:20.753973 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-3631fbe6-91c9-45e5-9846-e0c8e1cba0eb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:20.761062 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3631fbe6-91c9-45e5-9846-e0c8e1cba0eb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:20.761504 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3631fbe6-91c9-45e5-9846-e0c8e1cba0eb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:20.762291 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3631fbe6-91c9-45e5-9846-e0c8e1cba0eb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:20.762724 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3631fbe6-91c9-45e5-9846-e0c8e1cba0eb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:21.007631 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-3631fbe6-91c9-45e5-9846-e0c8e1cba0eb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:21.016344 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-3631fbe6-91c9-45e5-9846-e0c8e1cba0eb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1367 microversion: 2.1 time: 0.266722 May 19 12:22:21.016914 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 227/507] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:20 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:21.149901 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c73ab1bf-3d77-43e8-acfd-4681610ed393 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:21.150518 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c73ab1bf-3d77-43e8-acfd-4681610ed393 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:21.157549 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c73ab1bf-3d77-43e8-acfd-4681610ed393 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:21.158004 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c73ab1bf-3d77-43e8-acfd-4681610ed393 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:21.158774 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c73ab1bf-3d77-43e8-acfd-4681610ed393 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:21.159210 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c73ab1bf-3d77-43e8-acfd-4681610ed393 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:21.364572 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c73ab1bf-3d77-43e8-acfd-4681610ed393 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:21.372709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c73ab1bf-3d77-43e8-acfd-4681610ed393 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.227313 May 19 12:22:21.373291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 281/508] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:21 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:21.565162 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-51bb9622-a49e-4c4c-a7a2-e0fa8ec323a0 req-1b84f5df-5560-492f-9521-b2b1241ca0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9431305d-b1c8-46c1-9625-0d2e0643174e", "tag": "d1aaf37f-d3ed-4dc1-91e2-f291ae051dbf"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:22:21.573529 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-51bb9622-a49e-4c4c-a7a2-e0fa8ec323a0 req-1b84f5df-5560-492f-9521-b2b1241ca0a2 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:21.573977 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-51bb9622-a49e-4c4c-a7a2-e0fa8ec323a0 req-1b84f5df-5560-492f-9521-b2b1241ca0a2 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:21.585047 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-51bb9622-a49e-4c4c-a7a2-e0fa8ec323a0 req-1b84f5df-5560-492f-9521-b2b1241ca0a2 service nova] Creating event network-changed:d1aaf37f-d3ed-4dc1-91e2-f291ae051dbf for instance 9431305d-b1c8-46c1-9625-0d2e0643174e on hv-cinder-80475 May 19 12:22:21.591336 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-51bb9622-a49e-4c4c-a7a2-e0fa8ec323a0 req-1b84f5df-5560-492f-9521-b2b1241ca0a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030041 May 19 12:22:21.592729 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 228/509] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:22:22.034110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a481e4fe-f987-45e7-bae6-a15d6960e5d2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:22.034568 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a481e4fe-f987-45e7-bae6-a15d6960e5d2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:22.041825 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a481e4fe-f987-45e7-bae6-a15d6960e5d2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:22.042378 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a481e4fe-f987-45e7-bae6-a15d6960e5d2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:22.043107 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a481e4fe-f987-45e7-bae6-a15d6960e5d2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:22.043552 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a481e4fe-f987-45e7-bae6-a15d6960e5d2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:22.187369 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a481e4fe-f987-45e7-bae6-a15d6960e5d2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:22.196097 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a481e4fe-f987-45e7-bae6-a15d6960e5d2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1367 microversion: 2.1 time: 0.166371 May 19 12:22:22.196813 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 282/510] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:22 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:22.390986 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c9f68bc1-0163-4eae-8276-5454443c4745 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:22.391673 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c9f68bc1-0163-4eae-8276-5454443c4745 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:22.397948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c9f68bc1-0163-4eae-8276-5454443c4745 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:22.399149 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c9f68bc1-0163-4eae-8276-5454443c4745 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:22.399817 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c9f68bc1-0163-4eae-8276-5454443c4745 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:22.400238 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c9f68bc1-0163-4eae-8276-5454443c4745 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:22.404644 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=100 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:22.536136 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c9f68bc1-0163-4eae-8276-5454443c4745 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:22.544580 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c9f68bc1-0163-4eae-8276-5454443c4745 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.158158 May 19 12:22:22.545159 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 229/511] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:22 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:23.213667 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d04c795e-b332-4291-a9c7-95c2865ef863 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:23.214278 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d04c795e-b332-4291-a9c7-95c2865ef863 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:23.220961 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d04c795e-b332-4291-a9c7-95c2865ef863 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:23.221465 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d04c795e-b332-4291-a9c7-95c2865ef863 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:23.222235 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d04c795e-b332-4291-a9c7-95c2865ef863 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:23.222670 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d04c795e-b332-4291-a9c7-95c2865ef863 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:23.357074 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d04c795e-b332-4291-a9c7-95c2865ef863 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:23.365255 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d04c795e-b332-4291-a9c7-95c2865ef863 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1367 microversion: 2.1 time: 0.156328 May 19 12:22:23.365833 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 283/512] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:23 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:23.563026 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c9a5c89f-5380-44da-b1ec-bff0576d8e0f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:23.563505 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c9a5c89f-5380-44da-b1ec-bff0576d8e0f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:23.571134 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c9a5c89f-5380-44da-b1ec-bff0576d8e0f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:23.572219 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c9a5c89f-5380-44da-b1ec-bff0576d8e0f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:23.573062 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c9a5c89f-5380-44da-b1ec-bff0576d8e0f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:23.573501 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c9a5c89f-5380-44da-b1ec-bff0576d8e0f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:23.736627 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c9a5c89f-5380-44da-b1ec-bff0576d8e0f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:23.745644 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c9a5c89f-5380-44da-b1ec-bff0576d8e0f tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.186710 May 19 12:22:23.746255 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 230/513] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:23 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:23.835522 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-46323ca5-92bc-4ed5-b1c4-c9e3b0b39c90 req-8a1a46c5-2be2-4275-8255-7ba3d0693df6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cac13b6-2524-4f4b-879d-0e6723932d04", "tag": "4d47e479-3475-4012-b86f-9a5b42aaddf7"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:22:23.856866 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-46323ca5-92bc-4ed5-b1c4-c9e3b0b39c90 req-8a1a46c5-2be2-4275-8255-7ba3d0693df6 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:23.857328 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-46323ca5-92bc-4ed5-b1c4-c9e3b0b39c90 req-8a1a46c5-2be2-4275-8255-7ba3d0693df6 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:23.870405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-46323ca5-92bc-4ed5-b1c4-c9e3b0b39c90 req-8a1a46c5-2be2-4275-8255-7ba3d0693df6 service nova] Creating event network-changed:4d47e479-3475-4012-b86f-9a5b42aaddf7 for instance 8cac13b6-2524-4f4b-879d-0e6723932d04 on hv-cinder-80475 May 19 12:22:23.875669 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-46323ca5-92bc-4ed5-b1c4-c9e3b0b39c90 req-8a1a46c5-2be2-4275-8255-7ba3d0693df6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054903 May 19 12:22:23.876463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 284/514] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:22:24.382259 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-2302762b-6763-40db-852e-08d1ab07f307 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:24.382923 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-2302762b-6763-40db-852e-08d1ab07f307 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:24.389811 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2302762b-6763-40db-852e-08d1ab07f307 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:24.390256 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2302762b-6763-40db-852e-08d1ab07f307 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:24.391027 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2302762b-6763-40db-852e-08d1ab07f307 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:24.391459 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2302762b-6763-40db-852e-08d1ab07f307 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:24.531629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-2302762b-6763-40db-852e-08d1ab07f307 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:24.539682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-2302762b-6763-40db-852e-08d1ab07f307 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1367 microversion: 2.1 time: 0.161351 May 19 12:22:24.540307 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 231/515] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:24 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:24.766309 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f17af80a-c3fc-473c-b7ad-213655ed88d4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:24.766870 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f17af80a-c3fc-473c-b7ad-213655ed88d4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:24.774646 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f17af80a-c3fc-473c-b7ad-213655ed88d4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:24.775492 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f17af80a-c3fc-473c-b7ad-213655ed88d4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:24.776305 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f17af80a-c3fc-473c-b7ad-213655ed88d4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:24.776930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f17af80a-c3fc-473c-b7ad-213655ed88d4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:24.930765 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f17af80a-c3fc-473c-b7ad-213655ed88d4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:24.938860 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f17af80a-c3fc-473c-b7ad-213655ed88d4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.179506 May 19 12:22:24.939446 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 285/516] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:24 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:25.557999 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-880b519c-6501-431a-94dc-690a2d4ccf4b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:25.558600 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-880b519c-6501-431a-94dc-690a2d4ccf4b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:25.565618 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-880b519c-6501-431a-94dc-690a2d4ccf4b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:25.565962 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-880b519c-6501-431a-94dc-690a2d4ccf4b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:25.566735 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-880b519c-6501-431a-94dc-690a2d4ccf4b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:25.567160 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-880b519c-6501-431a-94dc-690a2d4ccf4b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:25.700629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-880b519c-6501-431a-94dc-690a2d4ccf4b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:25.708427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-880b519c-6501-431a-94dc-690a2d4ccf4b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1367 microversion: 2.1 time: 0.155110 May 19 12:22:25.709040 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 232/517] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:25 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:25.956745 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1f3658bd-9e96-472a-b98f-4c82e6a55265 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:25.957363 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1f3658bd-9e96-472a-b98f-4c82e6a55265 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:25.965472 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1f3658bd-9e96-472a-b98f-4c82e6a55265 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:25.965921 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1f3658bd-9e96-472a-b98f-4c82e6a55265 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:25.966695 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1f3658bd-9e96-472a-b98f-4c82e6a55265 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:25.967130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1f3658bd-9e96-472a-b98f-4c82e6a55265 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:26.101014 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1f3658bd-9e96-472a-b98f-4c82e6a55265 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:26.109320 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1f3658bd-9e96-472a-b98f-4c82e6a55265 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.156448 May 19 12:22:26.110149 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 286/518] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:25 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:26.725457 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6de952e1-09a4-4210-bcb6-c4e47bd1cc3b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:26.726201 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6de952e1-09a4-4210-bcb6-c4e47bd1cc3b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:26.733063 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6de952e1-09a4-4210-bcb6-c4e47bd1cc3b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:26.733512 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6de952e1-09a4-4210-bcb6-c4e47bd1cc3b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:26.734281 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6de952e1-09a4-4210-bcb6-c4e47bd1cc3b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:26.734970 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6de952e1-09a4-4210-bcb6-c4e47bd1cc3b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:26.861292 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-4aedaab0-a12d-4bce-a6cc-5f3262feea97 req-25f9c843-db0c-4324-ac30-1996e1e01251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da8d619-7d0b-4cfe-bf0b-f42f7d304db3", "name": "network-vif-plugged", "status": "completed", "tag": "e5cc5a87-b36f-4dee-a908-9a890b9f1ed7"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:22:26.878337 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-4aedaab0-a12d-4bce-a6cc-5f3262feea97 req-25f9c843-db0c-4324-ac30-1996e1e01251 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:26.879066 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-4aedaab0-a12d-4bce-a6cc-5f3262feea97 req-25f9c843-db0c-4324-ac30-1996e1e01251 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:26.894699 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6de952e1-09a4-4210-bcb6-c4e47bd1cc3b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:26.899325 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-4aedaab0-a12d-4bce-a6cc-5f3262feea97 req-25f9c843-db0c-4324-ac30-1996e1e01251 service nova] Creating event network-vif-plugged:e5cc5a87-b36f-4dee-a908-9a890b9f1ed7 for instance 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 on hv-cinder-80475 May 19 12:22:26.903251 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6de952e1-09a4-4210-bcb6-c4e47bd1cc3b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1367 microversion: 2.1 time: 0.181666 May 19 12:22:26.912867 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 233/519] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:26 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:26.913498 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-4aedaab0-a12d-4bce-a6cc-5f3262feea97 req-25f9c843-db0c-4324-ac30-1996e1e01251 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052039 May 19 12:22:26.913498 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 287/520] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:22:27.126699 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0a3b2d06-8469-46da-8afb-9531d52649fb tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:27.127215 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0a3b2d06-8469-46da-8afb-9531d52649fb tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:27.134239 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0a3b2d06-8469-46da-8afb-9531d52649fb tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:27.134749 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0a3b2d06-8469-46da-8afb-9531d52649fb tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:27.135463 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0a3b2d06-8469-46da-8afb-9531d52649fb tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:27.135937 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0a3b2d06-8469-46da-8afb-9531d52649fb tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:27.272580 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-0a3b2d06-8469-46da-8afb-9531d52649fb tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:27.281434 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0a3b2d06-8469-46da-8afb-9531d52649fb tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.158594 May 19 12:22:27.282012 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 234/521] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:27 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:27.921675 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-999ca643-49b8-465d-b62c-eb278169c403 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:27.922430 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-999ca643-49b8-465d-b62c-eb278169c403 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:27.928689 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-999ca643-49b8-465d-b62c-eb278169c403 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:27.929138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-999ca643-49b8-465d-b62c-eb278169c403 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:27.930115 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-999ca643-49b8-465d-b62c-eb278169c403 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:27.930550 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-999ca643-49b8-465d-b62c-eb278169c403 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:28.069608 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-999ca643-49b8-465d-b62c-eb278169c403 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:28.077784 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-999ca643-49b8-465d-b62c-eb278169c403 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1367 microversion: 2.1 time: 0.160882 May 19 12:22:28.078348 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 288/522] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:27 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:28.298731 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-755a9256-7005-4b08-b11b-5c7d18374eb2 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:28.299404 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-755a9256-7005-4b08-b11b-5c7d18374eb2 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:28.307264 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-755a9256-7005-4b08-b11b-5c7d18374eb2 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:28.307712 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-755a9256-7005-4b08-b11b-5c7d18374eb2 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:28.308551 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-755a9256-7005-4b08-b11b-5c7d18374eb2 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:28.309095 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-755a9256-7005-4b08-b11b-5c7d18374eb2 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:28.454017 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-755a9256-7005-4b08-b11b-5c7d18374eb2 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:28.462735 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-755a9256-7005-4b08-b11b-5c7d18374eb2 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.167996 May 19 12:22:28.463316 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 235/523] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:28 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:29.094916 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-efd66a8a-8669-4589-aa17-badad2a38380 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:29.095521 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-efd66a8a-8669-4589-aa17-badad2a38380 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:29.102357 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-efd66a8a-8669-4589-aa17-badad2a38380 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:29.102805 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-efd66a8a-8669-4589-aa17-badad2a38380 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:29.103755 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-efd66a8a-8669-4589-aa17-badad2a38380 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:29.104205 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-efd66a8a-8669-4589-aa17-badad2a38380 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:29.246508 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-efd66a8a-8669-4589-aa17-badad2a38380 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:29.255553 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-efd66a8a-8669-4589-aa17-badad2a38380 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1367 microversion: 2.1 time: 0.164116 May 19 12:22:29.256621 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 289/524] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:29 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:29.481160 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-24eddfa1-5d9b-4528-b8f2-3e4e436a61d4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:29.481721 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-24eddfa1-5d9b-4528-b8f2-3e4e436a61d4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:29.488075 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-24eddfa1-5d9b-4528-b8f2-3e4e436a61d4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:29.488511 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-24eddfa1-5d9b-4528-b8f2-3e4e436a61d4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:29.489279 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-24eddfa1-5d9b-4528-b8f2-3e4e436a61d4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:29.489709 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-24eddfa1-5d9b-4528-b8f2-3e4e436a61d4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:29.633157 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-24eddfa1-5d9b-4528-b8f2-3e4e436a61d4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:29.640923 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-24eddfa1-5d9b-4528-b8f2-3e4e436a61d4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1358 microversion: 2.1 time: 0.164754 May 19 12:22:29.641507 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 236/525] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:29 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:30.275819 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-98298089-c452-4716-9431-f347522df104 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:30.276410 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-98298089-c452-4716-9431-f347522df104 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:30.282985 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98298089-c452-4716-9431-f347522df104 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:30.283438 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98298089-c452-4716-9431-f347522df104 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:30.284245 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98298089-c452-4716-9431-f347522df104 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:30.284684 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98298089-c452-4716-9431-f347522df104 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:30.418885 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-98298089-c452-4716-9431-f347522df104 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:30.426371 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-98298089-c452-4716-9431-f347522df104 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1367 microversion: 2.1 time: 0.155661 May 19 12:22:30.426947 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 290/526] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:30 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:30.658471 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-2ce13501-a2c8-42d2-a977-9c187c96450e tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:30.659126 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-2ce13501-a2c8-42d2-a977-9c187c96450e tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:30.666593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2ce13501-a2c8-42d2-a977-9c187c96450e tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:30.667090 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2ce13501-a2c8-42d2-a977-9c187c96450e tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:30.667890 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2ce13501-a2c8-42d2-a977-9c187c96450e tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:30.668328 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2ce13501-a2c8-42d2-a977-9c187c96450e tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:30.805571 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-2ce13501-a2c8-42d2-a977-9c187c96450e tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:30.813233 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-2ce13501-a2c8-42d2-a977-9c187c96450e tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1547 microversion: 2.1 time: 0.158714 May 19 12:22:30.813802 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 237/527] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:30 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:30.829498 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-57f34f18-35a3-4fab-9581-898fe20514d5 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:30.830294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-57f34f18-35a3-4fab-9581-898fe20514d5 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:30.836519 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-57f34f18-35a3-4fab-9581-898fe20514d5 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:30.836961 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-57f34f18-35a3-4fab-9581-898fe20514d5 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:30.837720 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-57f34f18-35a3-4fab-9581-898fe20514d5 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:30.838150 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-57f34f18-35a3-4fab-9581-898fe20514d5 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:30.967471 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-57f34f18-35a3-4fab-9581-898fe20514d5 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:30.974919 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-57f34f18-35a3-4fab-9581-898fe20514d5 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1547 microversion: 2.1 time: 0.149257 May 19 12:22:30.975472 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 291/528] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:30 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:30.993077 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-af7f7f7a-f61e-457e-ba8c-60a242199269 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:30.996734 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-af7f7f7a-f61e-457e-ba8c-60a242199269 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:30.997584 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-af7f7f7a-f61e-457e-ba8c-60a242199269 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Searching by: {'deleted': False, 'project_id': '37c1366ee71c446b9ec6fa532391b789'} {{(pid=117964) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 12:22:31.004855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-af7f7f7a-f61e-457e-ba8c-60a242199269 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:31.005309 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-af7f7f7a-f61e-457e-ba8c-60a242199269 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:31.006143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-af7f7f7a-f61e-457e-ba8c-60a242199269 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:31.006580 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-af7f7f7a-f61e-457e-ba8c-60a242199269 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:31.098858 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.multi_cell_list [None req-af7f7f7a-f61e-457e-ba8c-60a242199269 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117964) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 12:22:31.197425 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-af7f7f7a-f61e-457e-ba8c-60a242199269 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.209295 May 19 12:22:31.198239 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 238/529] 10.222.0.23 () {58 vars in 1124 bytes} [Thu May 19 12:22:30 2022] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:22:31.208245 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4103073e-2105-4684-9638-e3c63a8f058b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:31.208875 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4103073e-2105-4684-9638-e3c63a8f058b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:31.216234 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4103073e-2105-4684-9638-e3c63a8f058b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:31.216589 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4103073e-2105-4684-9638-e3c63a8f058b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:31.217176 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4103073e-2105-4684-9638-e3c63a8f058b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:31.217617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4103073e-2105-4684-9638-e3c63a8f058b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:31.231592 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-1536fa60-7fb1-462d-b251-8110eef2ae9b req-fa328bf6-7558-4488-976c-99097115ae79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cac13b6-2524-4f4b-879d-0e6723932d04", "name": "network-vif-plugged", "status": "completed", "tag": "4d47e479-3475-4012-b86f-9a5b42aaddf7"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:22:31.240788 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-1536fa60-7fb1-462d-b251-8110eef2ae9b req-fa328bf6-7558-4488-976c-99097115ae79 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:31.241241 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-1536fa60-7fb1-462d-b251-8110eef2ae9b req-fa328bf6-7558-4488-976c-99097115ae79 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:31.253149 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-1536fa60-7fb1-462d-b251-8110eef2ae9b req-fa328bf6-7558-4488-976c-99097115ae79 service nova] Creating event network-vif-plugged:4d47e479-3475-4012-b86f-9a5b42aaddf7 for instance 8cac13b6-2524-4f4b-879d-0e6723932d04 on hv-cinder-80475 May 19 12:22:31.258429 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-1536fa60-7fb1-462d-b251-8110eef2ae9b req-fa328bf6-7558-4488-976c-99097115ae79 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033212 May 19 12:22:31.259046 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 239/530] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:22:31.359341 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4103073e-2105-4684-9638-e3c63a8f058b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:31.369905 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4103073e-2105-4684-9638-e3c63a8f058b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1547 microversion: 2.1 time: 0.164917 May 19 12:22:31.370106 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 292/531] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:31 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:31.444225 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-743d1497-e0e8-450b-a8c4-1a3879f14ca5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:31.445938 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-743d1497-e0e8-450b-a8c4-1a3879f14ca5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:31.460460 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-743d1497-e0e8-450b-a8c4-1a3879f14ca5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:31.461647 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-743d1497-e0e8-450b-a8c4-1a3879f14ca5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:31.462652 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-743d1497-e0e8-450b-a8c4-1a3879f14ca5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:31.463099 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-743d1497-e0e8-450b-a8c4-1a3879f14ca5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:31.605930 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-743d1497-e0e8-450b-a8c4-1a3879f14ca5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:31.613964 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-743d1497-e0e8-450b-a8c4-1a3879f14ca5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1367 microversion: 2.1 time: 0.173934 May 19 12:22:31.621809 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 240/532] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:31 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:32.631144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5e14b425-9a5e-4bbd-8c7a-243154012d89 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:32.631677 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5e14b425-9a5e-4bbd-8c7a-243154012d89 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:32.638716 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5e14b425-9a5e-4bbd-8c7a-243154012d89 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:32.639166 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5e14b425-9a5e-4bbd-8c7a-243154012d89 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:32.639962 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5e14b425-9a5e-4bbd-8c7a-243154012d89 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:32.640394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5e14b425-9a5e-4bbd-8c7a-243154012d89 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:32.776431 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5e14b425-9a5e-4bbd-8c7a-243154012d89 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:32.783994 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5e14b425-9a5e-4bbd-8c7a-243154012d89 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1367 microversion: 2.1 time: 0.156815 May 19 12:22:32.784553 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 293/533] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:32 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:33.653451 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-56e79762-7762-4b9b-a6f7-84d19085c566 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:33.654032 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-56e79762-7762-4b9b-a6f7-84d19085c566 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:33.657248 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:33.660680 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-56e79762-7762-4b9b-a6f7-84d19085c566 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:33.661110 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-56e79762-7762-4b9b-a6f7-84d19085c566 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:33.661959 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-56e79762-7762-4b9b-a6f7-84d19085c566 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:33.662396 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-56e79762-7762-4b9b-a6f7-84d19085c566 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:33.687598 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-56e79762-7762-4b9b-a6f7-84d19085c566 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/ips" status: 200 len: 152 microversion: 2.20 time: 0.038198 May 19 12:22:33.688273 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 241/534] 10.222.0.23 () {60 vars in 1288 bytes} [Thu May 19 12:22:33 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 12:22:33.802200 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c3a37b9a-4899-4d06-9a16-67988d0bb6a9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:33.803638 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c3a37b9a-4899-4d06-9a16-67988d0bb6a9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:33.813105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c3a37b9a-4899-4d06-9a16-67988d0bb6a9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:33.813552 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c3a37b9a-4899-4d06-9a16-67988d0bb6a9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:33.814364 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c3a37b9a-4899-4d06-9a16-67988d0bb6a9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:33.814806 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c3a37b9a-4899-4d06-9a16-67988d0bb6a9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:33.953360 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c3a37b9a-4899-4d06-9a16-67988d0bb6a9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:33.960828 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c3a37b9a-4899-4d06-9a16-67988d0bb6a9 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1367 microversion: 2.1 time: 0.163306 May 19 12:22:33.961394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 294/535] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:33 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:34.566922 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-46fd2be1-dd8e-44ee-926a-0c8ff4d5531e tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3d7810a-9c45-495e-a7c7-b061e0642dd7"}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:22:34.568034 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-46fd2be1-dd8e-44ee-926a-0c8ff4d5531e tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:34.576490 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-46fd2be1-dd8e-44ee-926a-0c8ff4d5531e tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:34.576841 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-46fd2be1-dd8e-44ee-926a-0c8ff4d5531e tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:34.577630 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-46fd2be1-dd8e-44ee-926a-0c8ff4d5531e tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:34.578074 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-46fd2be1-dd8e-44ee-926a-0c8ff4d5531e tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:34.977294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5ad3c991-5597-4dd0-9ab1-8d13d74f2b78 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:34.978038 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5ad3c991-5597-4dd0-9ab1-8d13d74f2b78 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:34.988282 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ad3c991-5597-4dd0-9ab1-8d13d74f2b78 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:34.988282 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ad3c991-5597-4dd0-9ab1-8d13d74f2b78 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:34.988282 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ad3c991-5597-4dd0-9ab1-8d13d74f2b78 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:34.988282 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ad3c991-5597-4dd0-9ab1-8d13d74f2b78 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:34.994325 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:35.125083 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5ad3c991-5597-4dd0-9ab1-8d13d74f2b78 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:35.134095 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5ad3c991-5597-4dd0-9ab1-8d13d74f2b78 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1556 microversion: 2.1 time: 0.160362 May 19 12:22:35.134770 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 295/536] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:34 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:22:35.150498 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a78bd3e8-03a1-4d68-afd8-da3db78c6c48 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:35.151021 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a78bd3e8-03a1-4d68-afd8-da3db78c6c48 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:35.157480 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a78bd3e8-03a1-4d68-afd8-da3db78c6c48 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:35.157922 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a78bd3e8-03a1-4d68-afd8-da3db78c6c48 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:35.158740 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a78bd3e8-03a1-4d68-afd8-da3db78c6c48 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:35.159172 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a78bd3e8-03a1-4d68-afd8-da3db78c6c48 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:35.245210 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a78bd3e8-03a1-4d68-afd8-da3db78c6c48 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097723 May 19 12:22:35.245850 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 296/537] 10.222.0.23 () {58 vars in 1274 bytes} [Thu May 19 12:22:35 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:22:35.645194 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-46fd2be1-dd8e-44ee-926a-0c8ff4d5531e tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "POST /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.081940 May 19 12:22:35.646442 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 242/538] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 19 12:22:34 2022] POST /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments => generated 194 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:22:36.289839 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-71458e0f-a48d-4264-8a8b-f3236ac33408 req-78583182-6069-4b22-a7df-93f15e2c2f55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cac13b6-2524-4f4b-879d-0e6723932d04", "tag": "4d47e479-3475-4012-b86f-9a5b42aaddf7"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:22:36.298247 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-71458e0f-a48d-4264-8a8b-f3236ac33408 req-78583182-6069-4b22-a7df-93f15e2c2f55 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:36.298731 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-71458e0f-a48d-4264-8a8b-f3236ac33408 req-78583182-6069-4b22-a7df-93f15e2c2f55 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:36.311116 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-71458e0f-a48d-4264-8a8b-f3236ac33408 req-78583182-6069-4b22-a7df-93f15e2c2f55 service nova] Creating event network-changed:4d47e479-3475-4012-b86f-9a5b42aaddf7 for instance 8cac13b6-2524-4f4b-879d-0e6723932d04 on hv-cinder-80475 May 19 12:22:36.316415 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-71458e0f-a48d-4264-8a8b-f3236ac33408 req-78583182-6069-4b22-a7df-93f15e2c2f55 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030793 May 19 12:22:36.316976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 297/539] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:22:37.138761 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-de140d55-04de-4be0-a64f-242317087087 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:22:37.139393 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-de140d55-04de-4be0-a64f-242317087087 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:37.146465 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-de140d55-04de-4be0-a64f-242317087087 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:37.147030 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-de140d55-04de-4be0-a64f-242317087087 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:37.148394 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-de140d55-04de-4be0-a64f-242317087087 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:37.148830 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-de140d55-04de-4be0-a64f-242317087087 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:37.175862 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.objects.instance [None req-de140d55-04de-4be0-a64f-242317087087 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lazy-loading 'flavor' on Instance uuid aedab7fb-ae90-48e1-8745-626d60c88a1a {{(pid=117964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:22:37.564309 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:38.098577 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-de140d55-04de-4be0-a64f-242317087087 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "POST /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/action" status: 202 len: 0 microversion: 2.20 time: 0.964455 May 19 12:22:38.099154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 243/540] 10.222.0.23 () {62 vars in 1318 bytes} [Thu May 19 12:22:37 2022] POST /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/action => generated 0 bytes in 966 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 19 12:22:38.110401 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ca2fa37b-f6be-42c7-b632-c795278e39f4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:38.111106 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ca2fa37b-f6be-42c7-b632-c795278e39f4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:38.118014 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ca2fa37b-f6be-42c7-b632-c795278e39f4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:38.118465 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ca2fa37b-f6be-42c7-b632-c795278e39f4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:38.119235 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ca2fa37b-f6be-42c7-b632-c795278e39f4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:38.119732 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ca2fa37b-f6be-42c7-b632-c795278e39f4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:38.263421 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ca2fa37b-f6be-42c7-b632-c795278e39f4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:38.271651 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ca2fa37b-f6be-42c7-b632-c795278e39f4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:38.273418 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ca2fa37b-f6be-42c7-b632-c795278e39f4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:38.274571 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ca2fa37b-f6be-42c7-b632-c795278e39f4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1722 microversion: 2.20 time: 0.169421 May 19 12:22:38.275290 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 298/541] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:22:38 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:22:39.294552 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9060c603-3fee-4002-9d70-621bc20def16 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:39.295245 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9060c603-3fee-4002-9d70-621bc20def16 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:39.301646 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9060c603-3fee-4002-9d70-621bc20def16 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:39.302106 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9060c603-3fee-4002-9d70-621bc20def16 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:39.302877 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9060c603-3fee-4002-9d70-621bc20def16 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:39.303311 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9060c603-3fee-4002-9d70-621bc20def16 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:39.438082 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9060c603-3fee-4002-9d70-621bc20def16 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:39.446799 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9060c603-3fee-4002-9d70-621bc20def16 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:39.448343 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9060c603-3fee-4002-9d70-621bc20def16 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:39.449503 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9060c603-3fee-4002-9d70-621bc20def16 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1722 microversion: 2.20 time: 0.159984 May 19 12:22:39.450065 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 244/542] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:22:39 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:22:40.467867 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0cbae1c4-b420-45a8-b33f-82a7a9ff957a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:40.468492 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0cbae1c4-b420-45a8-b33f-82a7a9ff957a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:40.475055 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0cbae1c4-b420-45a8-b33f-82a7a9ff957a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:40.475501 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0cbae1c4-b420-45a8-b33f-82a7a9ff957a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:40.476873 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0cbae1c4-b420-45a8-b33f-82a7a9ff957a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:40.477311 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0cbae1c4-b420-45a8-b33f-82a7a9ff957a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:40.621590 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0cbae1c4-b420-45a8-b33f-82a7a9ff957a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:40.629664 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0cbae1c4-b420-45a8-b33f-82a7a9ff957a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:40.631127 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0cbae1c4-b420-45a8-b33f-82a7a9ff957a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:40.632457 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0cbae1c4-b420-45a8-b33f-82a7a9ff957a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1722 microversion: 2.20 time: 0.168569 May 19 12:22:40.633020 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 299/543] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:22:40 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:22:41.650771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b61cb596-5635-4d34-b387-dda8c079d0e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:41.651394 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-b61cb596-5635-4d34-b387-dda8c079d0e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:41.653881 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=2 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:41.658821 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b61cb596-5635-4d34-b387-dda8c079d0e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:41.659274 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b61cb596-5635-4d34-b387-dda8c079d0e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:41.660062 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b61cb596-5635-4d34-b387-dda8c079d0e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:41.660501 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b61cb596-5635-4d34-b387-dda8c079d0e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:41.791132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b61cb596-5635-4d34-b387-dda8c079d0e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:41.799390 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b61cb596-5635-4d34-b387-dda8c079d0e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:41.801016 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b61cb596-5635-4d34-b387-dda8c079d0e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:41.802201 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b61cb596-5635-4d34-b387-dda8c079d0e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1722 microversion: 2.20 time: 0.155604 May 19 12:22:41.802755 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 245/544] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:22:41 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:22:42.821643 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7a7a5a24-2bac-454e-9f5a-7d1e5c1e64b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:42.822273 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7a7a5a24-2bac-454e-9f5a-7d1e5c1e64b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:42.824748 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=68 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:42.829446 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7a7a5a24-2bac-454e-9f5a-7d1e5c1e64b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:42.829888 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7a7a5a24-2bac-454e-9f5a-7d1e5c1e64b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:42.830642 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7a7a5a24-2bac-454e-9f5a-7d1e5c1e64b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:42.831073 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7a7a5a24-2bac-454e-9f5a-7d1e5c1e64b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:42.969158 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7a7a5a24-2bac-454e-9f5a-7d1e5c1e64b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:42.977493 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7a7a5a24-2bac-454e-9f5a-7d1e5c1e64b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:42.979018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7a7a5a24-2bac-454e-9f5a-7d1e5c1e64b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:42.980244 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7a7a5a24-2bac-454e-9f5a-7d1e5c1e64b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1722 microversion: 2.20 time: 0.163174 May 19 12:22:42.980808 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 300/545] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:22:42 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:22:43.999140 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6e863790-01d8-4dea-93c6-230b1eb5efff tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:43.999750 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6e863790-01d8-4dea-93c6-230b1eb5efff tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:44.006494 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6e863790-01d8-4dea-93c6-230b1eb5efff tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:44.007621 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6e863790-01d8-4dea-93c6-230b1eb5efff tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:44.008475 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6e863790-01d8-4dea-93c6-230b1eb5efff tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:44.008976 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6e863790-01d8-4dea-93c6-230b1eb5efff tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:44.143301 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6e863790-01d8-4dea-93c6-230b1eb5efff tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:44.152057 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6e863790-01d8-4dea-93c6-230b1eb5efff tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:44.154467 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6e863790-01d8-4dea-93c6-230b1eb5efff tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:44.155650 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6e863790-01d8-4dea-93c6-230b1eb5efff tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1722 microversion: 2.20 time: 0.160966 May 19 12:22:44.156242 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 246/546] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:22:43 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:22:45.174744 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-de655b7d-5fdc-4fe5-8b92-69c2e20f963d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:45.175626 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-de655b7d-5fdc-4fe5-8b92-69c2e20f963d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:45.183674 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-de655b7d-5fdc-4fe5-8b92-69c2e20f963d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:45.184171 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-de655b7d-5fdc-4fe5-8b92-69c2e20f963d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:45.184951 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-de655b7d-5fdc-4fe5-8b92-69c2e20f963d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:45.185440 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-de655b7d-5fdc-4fe5-8b92-69c2e20f963d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:45.329571 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-de655b7d-5fdc-4fe5-8b92-69c2e20f963d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:45.339744 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-de655b7d-5fdc-4fe5-8b92-69c2e20f963d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:45.341285 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-de655b7d-5fdc-4fe5-8b92-69c2e20f963d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:45.342452 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-de655b7d-5fdc-4fe5-8b92-69c2e20f963d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1722 microversion: 2.20 time: 0.171719 May 19 12:22:45.343025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 301/547] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:22:45 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:22:46.364789 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-615d0d10-9777-40df-970d-7063b03790b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:46.364789 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-615d0d10-9777-40df-970d-7063b03790b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:46.368829 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-615d0d10-9777-40df-970d-7063b03790b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:46.369345 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-615d0d10-9777-40df-970d-7063b03790b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:46.370128 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-615d0d10-9777-40df-970d-7063b03790b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:46.370558 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-615d0d10-9777-40df-970d-7063b03790b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:46.469910 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c91157f4-315b-4e1b-ab85-6914299971ed tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:46.470655 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c91157f4-315b-4e1b-ab85-6914299971ed tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:46.477373 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c91157f4-315b-4e1b-ab85-6914299971ed tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:46.477830 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c91157f4-315b-4e1b-ab85-6914299971ed tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:46.478606 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c91157f4-315b-4e1b-ab85-6914299971ed tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:46.479247 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c91157f4-315b-4e1b-ab85-6914299971ed tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:46.512987 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-615d0d10-9777-40df-970d-7063b03790b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:46.525618 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-615d0d10-9777-40df-970d-7063b03790b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:46.527500 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-615d0d10-9777-40df-970d-7063b03790b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:46.528886 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-615d0d10-9777-40df-970d-7063b03790b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1722 microversion: 2.20 time: 0.172169 May 19 12:22:46.529754 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 247/548] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:22:46 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:22:46.613778 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c91157f4-315b-4e1b-ab85-6914299971ed tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:46.622225 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c91157f4-315b-4e1b-ab85-6914299971ed tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1593 microversion: 2.1 time: 0.156132 May 19 12:22:46.622798 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 302/549] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:46 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1593 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:22:47.552963 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-262fa38f-9ec6-4203-a838-e782ed2f7dad tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:47.558699 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-262fa38f-9ec6-4203-a838-e782ed2f7dad tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:47.561822 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-262fa38f-9ec6-4203-a838-e782ed2f7dad tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:47.562281 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-262fa38f-9ec6-4203-a838-e782ed2f7dad tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:47.563126 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-262fa38f-9ec6-4203-a838-e782ed2f7dad tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:47.563574 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-262fa38f-9ec6-4203-a838-e782ed2f7dad tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:47.939724 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-262fa38f-9ec6-4203-a838-e782ed2f7dad tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:47.952997 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-262fa38f-9ec6-4203-a838-e782ed2f7dad tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:47.954533 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-262fa38f-9ec6-4203-a838-e782ed2f7dad tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:47.955942 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-262fa38f-9ec6-4203-a838-e782ed2f7dad tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1722 microversion: 2.20 time: 0.406862 May 19 12:22:47.956510 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 248/550] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:22:47 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1722 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:22:48.037614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3c058961-8728-4144-bdec-caf63844ed66 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36d4bb2b-45df-464c-a72c-84491cd36bbe"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:22:48.039996 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3c058961-8728-4144-bdec-caf63844ed66 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:48.046541 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3c058961-8728-4144-bdec-caf63844ed66 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:48.046996 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3c058961-8728-4144-bdec-caf63844ed66 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:48.047778 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3c058961-8728-4144-bdec-caf63844ed66 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:48.048240 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3c058961-8728-4144-bdec-caf63844ed66 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:48.965375 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3c058961-8728-4144-bdec-caf63844ed66 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "POST /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.931645 May 19 12:22:48.966004 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 303/551] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 19 12:22:48 2022] POST /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/os-volume_attachments => generated 194 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:22:48.974646 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e6ec94d8-8f55-4e00-a924-80dcc8908dbe tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:48.976393 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e6ec94d8-8f55-4e00-a924-80dcc8908dbe tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:48.983605 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e6ec94d8-8f55-4e00-a924-80dcc8908dbe tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:48.984188 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e6ec94d8-8f55-4e00-a924-80dcc8908dbe tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:48.985440 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e6ec94d8-8f55-4e00-a924-80dcc8908dbe tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:48.985916 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e6ec94d8-8f55-4e00-a924-80dcc8908dbe tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:49.131963 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e6ec94d8-8f55-4e00-a924-80dcc8908dbe tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:49.143153 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e6ec94d8-8f55-4e00-a924-80dcc8908dbe tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:49.144700 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e6ec94d8-8f55-4e00-a924-80dcc8908dbe tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:49.145869 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e6ec94d8-8f55-4e00-a924-80dcc8908dbe tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1722 microversion: 2.20 time: 0.175406 May 19 12:22:49.153131 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 249/552] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:22:48 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:22:49.498071 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-a8b2ffd9-c4da-40ea-a06e-97459d552dd8 req-59bf7b45-f8a7-48d1-9965-287b3808d8b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7da8d619-7d0b-4cfe-bf0b-f42f7d304db3", "tag": "e5cc5a87-b36f-4dee-a908-9a890b9f1ed7"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:22:49.508411 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-a8b2ffd9-c4da-40ea-a06e-97459d552dd8 req-59bf7b45-f8a7-48d1-9965-287b3808d8b4 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:49.508797 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-a8b2ffd9-c4da-40ea-a06e-97459d552dd8 req-59bf7b45-f8a7-48d1-9965-287b3808d8b4 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:49.520457 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-a8b2ffd9-c4da-40ea-a06e-97459d552dd8 req-59bf7b45-f8a7-48d1-9965-287b3808d8b4 service nova] Creating event network-changed:e5cc5a87-b36f-4dee-a908-9a890b9f1ed7 for instance 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 on hv-cinder-80475 May 19 12:22:49.526673 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-a8b2ffd9-c4da-40ea-a06e-97459d552dd8 req-59bf7b45-f8a7-48d1-9965-287b3808d8b4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033066 May 19 12:22:49.527428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 304/553] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:22:50.167824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0aacbf28-10ad-4bdd-821e-1795b7d0fdd7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:50.168940 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0aacbf28-10ad-4bdd-821e-1795b7d0fdd7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:50.176574 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0aacbf28-10ad-4bdd-821e-1795b7d0fdd7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:50.177682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0aacbf28-10ad-4bdd-821e-1795b7d0fdd7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:50.179482 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0aacbf28-10ad-4bdd-821e-1795b7d0fdd7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:50.187030 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0aacbf28-10ad-4bdd-821e-1795b7d0fdd7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:50.344079 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-0aacbf28-10ad-4bdd-821e-1795b7d0fdd7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:50.353580 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-0aacbf28-10ad-4bdd-821e-1795b7d0fdd7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:50.355038 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-0aacbf28-10ad-4bdd-821e-1795b7d0fdd7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:50.356262 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0aacbf28-10ad-4bdd-821e-1795b7d0fdd7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1722 microversion: 2.20 time: 0.195033 May 19 12:22:50.356826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 250/554] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:22:50 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:22:51.377763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0513c651-360f-4a5a-acd2-a7f62e2c7744 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:51.378457 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0513c651-360f-4a5a-acd2-a7f62e2c7744 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:51.386036 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0513c651-360f-4a5a-acd2-a7f62e2c7744 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:51.386487 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0513c651-360f-4a5a-acd2-a7f62e2c7744 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:51.387354 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0513c651-360f-4a5a-acd2-a7f62e2c7744 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:51.387811 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0513c651-360f-4a5a-acd2-a7f62e2c7744 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:51.651469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0513c651-360f-4a5a-acd2-a7f62e2c7744 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:51.659519 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0513c651-360f-4a5a-acd2-a7f62e2c7744 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:51.661106 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0513c651-360f-4a5a-acd2-a7f62e2c7744 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:51.662247 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0513c651-360f-4a5a-acd2-a7f62e2c7744 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1722 microversion: 2.20 time: 0.289229 May 19 12:22:51.663331 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 305/555] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:22:51 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:22:52.547483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-05c7dd5a-e86d-4c2e-b118-59abc378b168 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1317364270"}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:22:52.548698 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-05c7dd5a-e86d-4c2e-b118-59abc378b168 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:52.554788 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-05c7dd5a-e86d-4c2e-b118-59abc378b168 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:52.555269 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-05c7dd5a-e86d-4c2e-b118-59abc378b168 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:52.556048 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-05c7dd5a-e86d-4c2e-b118-59abc378b168 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:52.556494 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-05c7dd5a-e86d-4c2e-b118-59abc378b168 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:52.681059 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4b41b7aa-29bd-4609-be8e-fbbc6f714d43 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:52.681717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4b41b7aa-29bd-4609-be8e-fbbc6f714d43 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:52.688620 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4b41b7aa-29bd-4609-be8e-fbbc6f714d43 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:52.689106 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4b41b7aa-29bd-4609-be8e-fbbc6f714d43 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:52.689887 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4b41b7aa-29bd-4609-be8e-fbbc6f714d43 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:52.690375 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4b41b7aa-29bd-4609-be8e-fbbc6f714d43 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:52.771103 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.network.security_group_api [None req-05c7dd5a-e86d-4c2e-b118-59abc378b168 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Adding security group 6306b95e-e9fa-4ca1-9895-c0672ccfb0cb to port e5cc5a87-b36f-4dee-a908-9a890b9f1ed7 May 19 12:22:52.905655 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4b41b7aa-29bd-4609-be8e-fbbc6f714d43 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:52.914144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4b41b7aa-29bd-4609-be8e-fbbc6f714d43 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:52.915642 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4b41b7aa-29bd-4609-be8e-fbbc6f714d43 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:52.916836 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4b41b7aa-29bd-4609-be8e-fbbc6f714d43 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1722 microversion: 2.20 time: 0.239708 May 19 12:22:52.917400 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 306/556] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:22:52 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:22:53.319289 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-05c7dd5a-e86d-4c2e-b118-59abc378b168 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "POST /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/action" status: 202 len: 0 microversion: 2.1 time: 0.774811 May 19 12:22:53.324191 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 251/557] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 19 12:22:52 2022] POST /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/action => generated 0 bytes in 787 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:22:53.327985 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-17b67fc6-cc5d-4b04-8ea5-8717380b00c7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:53.328809 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-17b67fc6-cc5d-4b04-8ea5-8717380b00c7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:53.331529 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-5f937299-34e3-4546-9ff9-4785151b137d req-8eff5351-f0ee-4644-ab8b-d4f89723b37d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7da8d619-7d0b-4cfe-bf0b-f42f7d304db3", "tag": "e5cc5a87-b36f-4dee-a908-9a890b9f1ed7"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:22:53.336154 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17b67fc6-cc5d-4b04-8ea5-8717380b00c7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:53.336609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17b67fc6-cc5d-4b04-8ea5-8717380b00c7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:53.337394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17b67fc6-cc5d-4b04-8ea5-8717380b00c7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:53.338011 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17b67fc6-cc5d-4b04-8ea5-8717380b00c7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:53.342974 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-5f937299-34e3-4546-9ff9-4785151b137d req-8eff5351-f0ee-4644-ab8b-d4f89723b37d service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:53.343613 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-5f937299-34e3-4546-9ff9-4785151b137d req-8eff5351-f0ee-4644-ab8b-d4f89723b37d service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:53.361790 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-5f937299-34e3-4546-9ff9-4785151b137d req-8eff5351-f0ee-4644-ab8b-d4f89723b37d service nova] Creating event network-changed:e5cc5a87-b36f-4dee-a908-9a890b9f1ed7 for instance 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 on hv-cinder-80475 May 19 12:22:53.369644 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-5f937299-34e3-4546-9ff9-4785151b137d req-8eff5351-f0ee-4644-ab8b-d4f89723b37d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042343 May 19 12:22:53.375461 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 252/558] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:22:53.519472 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-17b67fc6-cc5d-4b04-8ea5-8717380b00c7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:53.528100 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-17b67fc6-cc5d-4b04-8ea5-8717380b00c7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1759 microversion: 2.1 time: 0.203797 May 19 12:22:53.540811 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 307/559] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:53 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1759 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:22:53.937376 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-32a7e477-b517-41aa-96c5-92499fe4da56 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:53.938834 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-32a7e477-b517-41aa-96c5-92499fe4da56 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:53.946622 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-32a7e477-b517-41aa-96c5-92499fe4da56 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:53.947367 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-32a7e477-b517-41aa-96c5-92499fe4da56 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:53.949208 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-32a7e477-b517-41aa-96c5-92499fe4da56 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:53.949842 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-32a7e477-b517-41aa-96c5-92499fe4da56 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:54.092480 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-32a7e477-b517-41aa-96c5-92499fe4da56 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:54.101587 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-32a7e477-b517-41aa-96c5-92499fe4da56 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:54.103181 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-32a7e477-b517-41aa-96c5-92499fe4da56 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:54.107923 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-32a7e477-b517-41aa-96c5-92499fe4da56 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1722 microversion: 2.20 time: 0.172098 May 19 12:22:54.107923 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 253/560] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:22:53 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:22:55.123022 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-365aee9c-ffd5-423c-a93d-e7783a96c7dc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:55.123559 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-365aee9c-ffd5-423c-a93d-e7783a96c7dc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:55.130256 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-365aee9c-ffd5-423c-a93d-e7783a96c7dc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:55.130710 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-365aee9c-ffd5-423c-a93d-e7783a96c7dc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:55.131542 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-365aee9c-ffd5-423c-a93d-e7783a96c7dc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:55.132013 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-365aee9c-ffd5-423c-a93d-e7783a96c7dc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:55.264551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-365aee9c-ffd5-423c-a93d-e7783a96c7dc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:55.273712 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-365aee9c-ffd5-423c-a93d-e7783a96c7dc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:55.275258 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-365aee9c-ffd5-423c-a93d-e7783a96c7dc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:55.276486 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-365aee9c-ffd5-423c-a93d-e7783a96c7dc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1722 microversion: 2.20 time: 0.157538 May 19 12:22:55.277947 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 308/561] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:22:55 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:22:56.294817 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-06d3d592-9fcf-490b-a591-c179a138b6ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:56.295394 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-06d3d592-9fcf-490b-a591-c179a138b6ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:56.301969 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-06d3d592-9fcf-490b-a591-c179a138b6ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:56.302442 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-06d3d592-9fcf-490b-a591-c179a138b6ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:56.303841 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-06d3d592-9fcf-490b-a591-c179a138b6ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:56.304289 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-06d3d592-9fcf-490b-a591-c179a138b6ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:56.436345 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-06d3d592-9fcf-490b-a591-c179a138b6ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:56.446558 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-06d3d592-9fcf-490b-a591-c179a138b6ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:56.448315 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-06d3d592-9fcf-490b-a591-c179a138b6ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:56.449628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-06d3d592-9fcf-490b-a591-c179a138b6ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1743 microversion: 2.20 time: 0.158885 May 19 12:22:56.450535 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 254/562] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:22:56 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:22:57.468774 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9a277a9e-6446-4725-9108-f40c8c3c2c4b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:57.469316 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9a277a9e-6446-4725-9108-f40c8c3c2c4b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:57.477327 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a277a9e-6446-4725-9108-f40c8c3c2c4b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:57.477783 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a277a9e-6446-4725-9108-f40c8c3c2c4b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:57.478648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a277a9e-6446-4725-9108-f40c8c3c2c4b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:57.479000 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a277a9e-6446-4725-9108-f40c8c3c2c4b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:57.632486 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9a277a9e-6446-4725-9108-f40c8c3c2c4b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:57.640610 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9a277a9e-6446-4725-9108-f40c8c3c2c4b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:57.642156 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9a277a9e-6446-4725-9108-f40c8c3c2c4b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:57.643496 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9a277a9e-6446-4725-9108-f40c8c3c2c4b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1743 microversion: 2.20 time: 0.178780 May 19 12:22:57.644120 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 309/563] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:22:57 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1743 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:22:58.663227 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f074559b-699f-489a-acca-50dcf19502fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:58.664016 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f074559b-699f-489a-acca-50dcf19502fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:58.666197 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-770e10a7-a52f-445a-8661-125a8054328c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:22:58.667213 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-770e10a7-a52f-445a-8661-125a8054328c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:58.670757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f074559b-699f-489a-acca-50dcf19502fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:58.671295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f074559b-699f-489a-acca-50dcf19502fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:58.672095 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f074559b-699f-489a-acca-50dcf19502fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:58.672529 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f074559b-699f-489a-acca-50dcf19502fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:58.674256 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-770e10a7-a52f-445a-8661-125a8054328c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:58.674693 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-770e10a7-a52f-445a-8661-125a8054328c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:58.675458 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-770e10a7-a52f-445a-8661-125a8054328c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:58.675927 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-770e10a7-a52f-445a-8661-125a8054328c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:58.700429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-770e10a7-a52f-445a-8661-125a8054328c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lazy-loading 'flavor' on Instance uuid caffcacb-8fb4-412e-ae78-67570b491068 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:22:58.810051 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f074559b-699f-489a-acca-50dcf19502fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:58.818400 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f074559b-699f-489a-acca-50dcf19502fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:58.830183 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f074559b-699f-489a-acca-50dcf19502fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:58.830183 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f074559b-699f-489a-acca-50dcf19502fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1743 microversion: 2.20 time: 0.162848 May 19 12:22:58.830183 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 255/564] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:22:58 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:22:59.045524 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:59.267708 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-a7522c27-2e60-47cd-914e-00b7f4826338 req-a393d596-743d-4123-b6f6-040904ef75b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aedab7fb-ae90-48e1-8745-626d60c88a1a", "name": "network-vif-plugged", "status": "completed", "tag": "5fc43837-dd78-4f9a-ab74-cfe109a4819d"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:22:59.277112 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-a7522c27-2e60-47cd-914e-00b7f4826338 req-a393d596-743d-4123-b6f6-040904ef75b3 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:59.277612 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-a7522c27-2e60-47cd-914e-00b7f4826338 req-a393d596-743d-4123-b6f6-040904ef75b3 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:59.289030 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-a7522c27-2e60-47cd-914e-00b7f4826338 req-a393d596-743d-4123-b6f6-040904ef75b3 service nova] Creating event network-vif-plugged:5fc43837-dd78-4f9a-ab74-cfe109a4819d for instance aedab7fb-ae90-48e1-8745-626d60c88a1a on hv-cinder-80475 May 19 12:22:59.294053 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-a7522c27-2e60-47cd-914e-00b7f4826338 req-a393d596-743d-4123-b6f6-040904ef75b3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030190 May 19 12:22:59.294659 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 256/565] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:22:59.376442 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-770e10a7-a52f-445a-8661-125a8054328c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "POST /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/action" status: 200 len: 32 microversion: 2.1 time: 0.715187 May 19 12:22:59.377047 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 310/566] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 19 12:22:58 2022] POST /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/action => generated 32 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 12:22:59.388913 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-7155f783-c839-4de4-83bd-486046e0311c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:59.390133 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-7155f783-c839-4de4-83bd-486046e0311c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:59.398443 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7155f783-c839-4de4-83bd-486046e0311c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:59.399033 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7155f783-c839-4de4-83bd-486046e0311c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:59.400024 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7155f783-c839-4de4-83bd-486046e0311c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:59.400461 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7155f783-c839-4de4-83bd-486046e0311c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:59.536494 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-7155f783-c839-4de4-83bd-486046e0311c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:59.544635 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-7155f783-c839-4de4-83bd-486046e0311c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1737 microversion: 2.1 time: 0.161324 May 19 12:22:59.545192 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 257/567] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:22:59 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:59.842447 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d661097d-24cf-4321-9c4f-7b90e59915df tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:59.843143 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d661097d-24cf-4321-9c4f-7b90e59915df tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:22:59.850032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d661097d-24cf-4321-9c4f-7b90e59915df tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:59.851138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d661097d-24cf-4321-9c4f-7b90e59915df tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:59.851945 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d661097d-24cf-4321-9c4f-7b90e59915df tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:59.852388 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d661097d-24cf-4321-9c4f-7b90e59915df tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:59.991845 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d661097d-24cf-4321-9c4f-7b90e59915df tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:22:59.999854 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d661097d-24cf-4321-9c4f-7b90e59915df tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:00.001395 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d661097d-24cf-4321-9c4f-7b90e59915df tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:00.002548 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d661097d-24cf-4321-9c4f-7b90e59915df tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1743 microversion: 2.20 time: 0.165971 May 19 12:23:00.003112 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 311/568] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:22:59 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:00.673831 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e89a494d-aeb1-4c66-829d-9b940308da0e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:00.674442 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e89a494d-aeb1-4c66-829d-9b940308da0e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:00.681508 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e89a494d-aeb1-4c66-829d-9b940308da0e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:00.681952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e89a494d-aeb1-4c66-829d-9b940308da0e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:00.682730 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e89a494d-aeb1-4c66-829d-9b940308da0e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:00.683167 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e89a494d-aeb1-4c66-829d-9b940308da0e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:00.814573 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e89a494d-aeb1-4c66-829d-9b940308da0e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:00.823059 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e89a494d-aeb1-4c66-829d-9b940308da0e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1737 microversion: 2.1 time: 0.264668 May 19 12:23:00.823616 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 258/569] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:00 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1737 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:01.026793 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1fdf525c-850b-4d7e-88cf-275fdc7f4fd5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:01.027424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1fdf525c-850b-4d7e-88cf-275fdc7f4fd5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:01.034000 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1fdf525c-850b-4d7e-88cf-275fdc7f4fd5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:01.034443 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1fdf525c-850b-4d7e-88cf-275fdc7f4fd5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:01.035197 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1fdf525c-850b-4d7e-88cf-275fdc7f4fd5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:01.035629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1fdf525c-850b-4d7e-88cf-275fdc7f4fd5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:01.174594 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1fdf525c-850b-4d7e-88cf-275fdc7f4fd5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:01.183617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1fdf525c-850b-4d7e-88cf-275fdc7f4fd5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:01.185144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1fdf525c-850b-4d7e-88cf-275fdc7f4fd5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:01.186299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1fdf525c-850b-4d7e-88cf-275fdc7f4fd5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1743 microversion: 2.20 time: 0.163443 May 19 12:23:01.186859 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 312/570] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:01 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:01.841053 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-2d696d8b-16bf-4a85-9370-81eaa2a5b075 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:01.841652 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-2d696d8b-16bf-4a85-9370-81eaa2a5b075 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:01.848127 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2d696d8b-16bf-4a85-9370-81eaa2a5b075 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:01.848572 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2d696d8b-16bf-4a85-9370-81eaa2a5b075 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:01.849329 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2d696d8b-16bf-4a85-9370-81eaa2a5b075 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:01.850382 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2d696d8b-16bf-4a85-9370-81eaa2a5b075 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:01.980598 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-2d696d8b-16bf-4a85-9370-81eaa2a5b075 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:01.988856 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-2d696d8b-16bf-4a85-9370-81eaa2a5b075 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1737 microversion: 2.1 time: 0.151678 May 19 12:23:01.989421 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 259/571] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:01 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:02.205259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-37c4db4e-c7ab-4fbd-9531-48b5b77afac9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:02.205798 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-37c4db4e-c7ab-4fbd-9531-48b5b77afac9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:02.213579 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-37c4db4e-c7ab-4fbd-9531-48b5b77afac9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:02.214028 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-37c4db4e-c7ab-4fbd-9531-48b5b77afac9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:02.214849 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-37c4db4e-c7ab-4fbd-9531-48b5b77afac9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:02.215288 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-37c4db4e-c7ab-4fbd-9531-48b5b77afac9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:02.345104 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-37c4db4e-c7ab-4fbd-9531-48b5b77afac9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:02.353610 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-37c4db4e-c7ab-4fbd-9531-48b5b77afac9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:02.355106 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-37c4db4e-c7ab-4fbd-9531-48b5b77afac9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:02.356305 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-37c4db4e-c7ab-4fbd-9531-48b5b77afac9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1743 microversion: 2.20 time: 0.155059 May 19 12:23:02.356859 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 313/572] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:02 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:03.006112 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-48d35ac3-422a-4783-8aed-e09b55895eb8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:03.006719 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-48d35ac3-422a-4783-8aed-e09b55895eb8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:03.014201 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-48d35ac3-422a-4783-8aed-e09b55895eb8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:03.014742 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-48d35ac3-422a-4783-8aed-e09b55895eb8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:03.015561 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-48d35ac3-422a-4783-8aed-e09b55895eb8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:03.015977 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-48d35ac3-422a-4783-8aed-e09b55895eb8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:03.150375 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-48d35ac3-422a-4783-8aed-e09b55895eb8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:03.158353 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-48d35ac3-422a-4783-8aed-e09b55895eb8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1737 microversion: 2.1 time: 0.156120 May 19 12:23:03.158904 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 260/573] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:03 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:03.375411 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0fb52bb0-0767-4b2c-8592-6e61bf88eb3c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:03.376051 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0fb52bb0-0767-4b2c-8592-6e61bf88eb3c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:03.382605 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0fb52bb0-0767-4b2c-8592-6e61bf88eb3c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:03.383050 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0fb52bb0-0767-4b2c-8592-6e61bf88eb3c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:03.383829 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0fb52bb0-0767-4b2c-8592-6e61bf88eb3c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:03.384264 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0fb52bb0-0767-4b2c-8592-6e61bf88eb3c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:03.513389 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0fb52bb0-0767-4b2c-8592-6e61bf88eb3c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:03.522092 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0fb52bb0-0767-4b2c-8592-6e61bf88eb3c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:03.523700 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0fb52bb0-0767-4b2c-8592-6e61bf88eb3c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:03.524867 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0fb52bb0-0767-4b2c-8592-6e61bf88eb3c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1743 microversion: 2.20 time: 0.153508 May 19 12:23:03.525425 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 314/574] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:03 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:04.175951 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5d7862e4-9755-4fc6-82b0-30a7cdebcbeb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:04.176603 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5d7862e4-9755-4fc6-82b0-30a7cdebcbeb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:04.184006 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5d7862e4-9755-4fc6-82b0-30a7cdebcbeb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:04.184459 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5d7862e4-9755-4fc6-82b0-30a7cdebcbeb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:04.185239 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5d7862e4-9755-4fc6-82b0-30a7cdebcbeb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:04.185669 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5d7862e4-9755-4fc6-82b0-30a7cdebcbeb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:04.204069 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:04.321505 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5d7862e4-9755-4fc6-82b0-30a7cdebcbeb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:04.329415 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5d7862e4-9755-4fc6-82b0-30a7cdebcbeb tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1737 microversion: 2.1 time: 0.157554 May 19 12:23:04.329985 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 261/575] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:04 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:04.543481 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9a9c4237-a137-449a-b9a2-c6bf61e745c1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:04.544060 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9a9c4237-a137-449a-b9a2-c6bf61e745c1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:04.550667 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a9c4237-a137-449a-b9a2-c6bf61e745c1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:04.551175 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a9c4237-a137-449a-b9a2-c6bf61e745c1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:04.552011 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a9c4237-a137-449a-b9a2-c6bf61e745c1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:04.552445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a9c4237-a137-449a-b9a2-c6bf61e745c1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:04.689307 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9a9c4237-a137-449a-b9a2-c6bf61e745c1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:04.698215 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9a9c4237-a137-449a-b9a2-c6bf61e745c1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:04.699861 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9a9c4237-a137-449a-b9a2-c6bf61e745c1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:04.701043 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9a9c4237-a137-449a-b9a2-c6bf61e745c1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1738 microversion: 2.20 time: 0.161720 May 19 12:23:04.701603 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 315/576] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:04 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:05.346905 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-44527280-5552-48b0-9e2a-4a5d116bb0fe tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:05.347651 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-44527280-5552-48b0-9e2a-4a5d116bb0fe tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:05.350154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=41 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:05.359598 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-44527280-5552-48b0-9e2a-4a5d116bb0fe tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:05.360091 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-44527280-5552-48b0-9e2a-4a5d116bb0fe tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:05.362000 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-44527280-5552-48b0-9e2a-4a5d116bb0fe tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:05.363757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-44527280-5552-48b0-9e2a-4a5d116bb0fe tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:05.551415 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-44527280-5552-48b0-9e2a-4a5d116bb0fe tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:05.559684 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-44527280-5552-48b0-9e2a-4a5d116bb0fe tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1737 microversion: 2.1 time: 0.217059 May 19 12:23:05.570289 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 262/577] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:05 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1737 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:05.721984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-285112c1-2557-49a6-9da9-40aa942736ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:05.722629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-285112c1-2557-49a6-9da9-40aa942736ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:05.731026 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-285112c1-2557-49a6-9da9-40aa942736ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:05.731568 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-285112c1-2557-49a6-9da9-40aa942736ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:05.732555 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-285112c1-2557-49a6-9da9-40aa942736ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:05.733122 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-285112c1-2557-49a6-9da9-40aa942736ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:05.940727 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-285112c1-2557-49a6-9da9-40aa942736ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:05.959664 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-285112c1-2557-49a6-9da9-40aa942736ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:05.962266 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-285112c1-2557-49a6-9da9-40aa942736ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:05.963813 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-285112c1-2557-49a6-9da9-40aa942736ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1738 microversion: 2.20 time: 0.246316 May 19 12:23:05.973585 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 316/578] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:05 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:06.590664 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e45c5b71-8c6f-4adb-b564-4658786b70a4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:06.594047 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e45c5b71-8c6f-4adb-b564-4658786b70a4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:06.618969 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e45c5b71-8c6f-4adb-b564-4658786b70a4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:06.620633 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e45c5b71-8c6f-4adb-b564-4658786b70a4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:06.623740 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e45c5b71-8c6f-4adb-b564-4658786b70a4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:06.625648 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e45c5b71-8c6f-4adb-b564-4658786b70a4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:06.784981 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e45c5b71-8c6f-4adb-b564-4658786b70a4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:06.803714 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e45c5b71-8c6f-4adb-b564-4658786b70a4 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1737 microversion: 2.1 time: 0.228397 May 19 12:23:06.804953 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 263/579] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:06 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1737 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:06.982878 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-346b952d-7877-430b-9717-098a6b8b691b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:06.984223 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-346b952d-7877-430b-9717-098a6b8b691b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:06.992302 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-346b952d-7877-430b-9717-098a6b8b691b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:06.998207 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-346b952d-7877-430b-9717-098a6b8b691b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:06.998207 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-346b952d-7877-430b-9717-098a6b8b691b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:06.998207 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-346b952d-7877-430b-9717-098a6b8b691b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:07.142666 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-346b952d-7877-430b-9717-098a6b8b691b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:07.157437 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-346b952d-7877-430b-9717-098a6b8b691b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:07.159940 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-346b952d-7877-430b-9717-098a6b8b691b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:07.162932 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-346b952d-7877-430b-9717-098a6b8b691b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1738 microversion: 2.20 time: 0.183118 May 19 12:23:07.164271 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 317/580] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:06 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:07.822176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-dc83e3e7-0e60-4931-8b04-31bad6a9ed2f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:07.823226 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-dc83e3e7-0e60-4931-8b04-31bad6a9ed2f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:07.831436 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dc83e3e7-0e60-4931-8b04-31bad6a9ed2f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:07.832031 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dc83e3e7-0e60-4931-8b04-31bad6a9ed2f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:07.832871 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dc83e3e7-0e60-4931-8b04-31bad6a9ed2f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:07.833346 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dc83e3e7-0e60-4931-8b04-31bad6a9ed2f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:07.984842 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-dc83e3e7-0e60-4931-8b04-31bad6a9ed2f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:07.993065 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-dc83e3e7-0e60-4931-8b04-31bad6a9ed2f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1737 microversion: 2.1 time: 0.175837 May 19 12:23:07.993638 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 264/581] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:07 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:23:08.188073 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-88ccce7f-f71a-46ad-bbf0-9f8c6203835c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:08.188641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-88ccce7f-f71a-46ad-bbf0-9f8c6203835c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:08.196136 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-88ccce7f-f71a-46ad-bbf0-9f8c6203835c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:08.196352 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-88ccce7f-f71a-46ad-bbf0-9f8c6203835c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:08.197104 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-88ccce7f-f71a-46ad-bbf0-9f8c6203835c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:08.197530 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-88ccce7f-f71a-46ad-bbf0-9f8c6203835c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:08.342579 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-88ccce7f-f71a-46ad-bbf0-9f8c6203835c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:08.351025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-88ccce7f-f71a-46ad-bbf0-9f8c6203835c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:08.352595 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-88ccce7f-f71a-46ad-bbf0-9f8c6203835c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:08.353774 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-88ccce7f-f71a-46ad-bbf0-9f8c6203835c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1738 microversion: 2.20 time: 0.169701 May 19 12:23:08.354320 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 318/582] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:08 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:09.010868 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-3550b37d-6d7b-4fe6-8032-ad1eb5b1f4d1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:09.011446 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-3550b37d-6d7b-4fe6-8032-ad1eb5b1f4d1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:09.019663 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3550b37d-6d7b-4fe6-8032-ad1eb5b1f4d1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:09.020143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3550b37d-6d7b-4fe6-8032-ad1eb5b1f4d1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:09.021007 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3550b37d-6d7b-4fe6-8032-ad1eb5b1f4d1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:09.021458 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3550b37d-6d7b-4fe6-8032-ad1eb5b1f4d1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:09.168951 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-3550b37d-6d7b-4fe6-8032-ad1eb5b1f4d1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:09.177569 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-3550b37d-6d7b-4fe6-8032-ad1eb5b1f4d1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1737 microversion: 2.1 time: 0.170555 May 19 12:23:09.180035 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 265/583] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:09 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:23:09.373657 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e76307e5-883c-47b2-924b-117dbf4f7c31 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:09.374290 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e76307e5-883c-47b2-924b-117dbf4f7c31 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:09.381805 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e76307e5-883c-47b2-924b-117dbf4f7c31 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:09.382250 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e76307e5-883c-47b2-924b-117dbf4f7c31 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:09.383167 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e76307e5-883c-47b2-924b-117dbf4f7c31 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:09.383664 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e76307e5-883c-47b2-924b-117dbf4f7c31 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:09.527229 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e76307e5-883c-47b2-924b-117dbf4f7c31 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:09.536152 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e76307e5-883c-47b2-924b-117dbf4f7c31 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:09.538334 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e76307e5-883c-47b2-924b-117dbf4f7c31 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:09.539526 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e76307e5-883c-47b2-924b-117dbf4f7c31 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1738 microversion: 2.20 time: 0.170824 May 19 12:23:09.540120 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 319/584] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:09 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:10.196402 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0e9b40fe-b2e4-4d61-b93a-6795e03ffc27 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:10.197007 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0e9b40fe-b2e4-4d61-b93a-6795e03ffc27 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:10.204118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0e9b40fe-b2e4-4d61-b93a-6795e03ffc27 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:10.204483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0e9b40fe-b2e4-4d61-b93a-6795e03ffc27 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:10.205256 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0e9b40fe-b2e4-4d61-b93a-6795e03ffc27 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:10.205680 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0e9b40fe-b2e4-4d61-b93a-6795e03ffc27 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:10.360147 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-0e9b40fe-b2e4-4d61-b93a-6795e03ffc27 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:10.369101 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0e9b40fe-b2e4-4d61-b93a-6795e03ffc27 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1737 microversion: 2.1 time: 0.176915 May 19 12:23:10.369981 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 266/585] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:10 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:10.559172 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-de6cf99c-8faa-43ce-9145-c71af52a8937 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:10.559806 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-de6cf99c-8faa-43ce-9145-c71af52a8937 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:10.567668 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-de6cf99c-8faa-43ce-9145-c71af52a8937 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:10.568141 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-de6cf99c-8faa-43ce-9145-c71af52a8937 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:10.568946 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-de6cf99c-8faa-43ce-9145-c71af52a8937 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:10.569384 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-de6cf99c-8faa-43ce-9145-c71af52a8937 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:10.715491 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-de6cf99c-8faa-43ce-9145-c71af52a8937 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:10.726111 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-de6cf99c-8faa-43ce-9145-c71af52a8937 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:10.727634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-de6cf99c-8faa-43ce-9145-c71af52a8937 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:10.729039 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-de6cf99c-8faa-43ce-9145-c71af52a8937 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1738 microversion: 2.20 time: 0.173804 May 19 12:23:10.730077 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 320/586] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:10 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:11.386672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-fdfce835-4e12-4987-9dc0-6a66fca6bdc8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:11.387288 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-fdfce835-4e12-4987-9dc0-6a66fca6bdc8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:11.394424 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fdfce835-4e12-4987-9dc0-6a66fca6bdc8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:11.395154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fdfce835-4e12-4987-9dc0-6a66fca6bdc8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:11.395987 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fdfce835-4e12-4987-9dc0-6a66fca6bdc8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:11.396696 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fdfce835-4e12-4987-9dc0-6a66fca6bdc8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:11.552969 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-fdfce835-4e12-4987-9dc0-6a66fca6bdc8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:11.561795 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-fdfce835-4e12-4987-9dc0-6a66fca6bdc8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1737 microversion: 2.1 time: 0.178948 May 19 12:23:11.562631 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 267/587] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:11 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:11.749237 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f30e2426-0d93-415a-922e-03468793522d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:11.750599 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f30e2426-0d93-415a-922e-03468793522d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:11.757815 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f30e2426-0d93-415a-922e-03468793522d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:11.758810 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f30e2426-0d93-415a-922e-03468793522d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:11.759596 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f30e2426-0d93-415a-922e-03468793522d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:11.760061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f30e2426-0d93-415a-922e-03468793522d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:11.913571 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f30e2426-0d93-415a-922e-03468793522d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:11.923702 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f30e2426-0d93-415a-922e-03468793522d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:11.925458 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f30e2426-0d93-415a-922e-03468793522d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:11.926757 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f30e2426-0d93-415a-922e-03468793522d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1738 microversion: 2.20 time: 0.181784 May 19 12:23:11.937984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 321/588] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:11 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:12.581269 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-7edfe9d7-3987-4bd1-b0e4-500517115987 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:12.581884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-7edfe9d7-3987-4bd1-b0e4-500517115987 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:12.588810 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7edfe9d7-3987-4bd1-b0e4-500517115987 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:12.589261 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7edfe9d7-3987-4bd1-b0e4-500517115987 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:12.590036 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7edfe9d7-3987-4bd1-b0e4-500517115987 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:12.590470 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7edfe9d7-3987-4bd1-b0e4-500517115987 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:12.741135 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-7edfe9d7-3987-4bd1-b0e4-500517115987 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:12.749059 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-7edfe9d7-3987-4bd1-b0e4-500517115987 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1737 microversion: 2.1 time: 0.173803 May 19 12:23:12.749618 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 268/589] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:12 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:23:12.946134 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c42a39fa-76a7-4ebd-be5c-96b629661fe4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:12.946699 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c42a39fa-76a7-4ebd-be5c-96b629661fe4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:12.949255 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=44 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:12.954400 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c42a39fa-76a7-4ebd-be5c-96b629661fe4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:12.954855 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c42a39fa-76a7-4ebd-be5c-96b629661fe4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:12.955623 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c42a39fa-76a7-4ebd-be5c-96b629661fe4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:12.956107 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c42a39fa-76a7-4ebd-be5c-96b629661fe4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:13.108225 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c42a39fa-76a7-4ebd-be5c-96b629661fe4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:13.120498 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c42a39fa-76a7-4ebd-be5c-96b629661fe4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:13.124540 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c42a39fa-76a7-4ebd-be5c-96b629661fe4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:13.125833 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c42a39fa-76a7-4ebd-be5c-96b629661fe4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1738 microversion: 2.20 time: 0.184226 May 19 12:23:13.127630 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 322/590] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:12 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:13.767342 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c52ba363-d366-4c8d-8b3c-f6b28a58d54f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:13.769425 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c52ba363-d366-4c8d-8b3c-f6b28a58d54f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:13.781888 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c52ba363-d366-4c8d-8b3c-f6b28a58d54f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:13.782568 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c52ba363-d366-4c8d-8b3c-f6b28a58d54f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:13.783428 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c52ba363-d366-4c8d-8b3c-f6b28a58d54f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:13.783978 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c52ba363-d366-4c8d-8b3c-f6b28a58d54f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:13.954958 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c52ba363-d366-4c8d-8b3c-f6b28a58d54f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:13.964633 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c52ba363-d366-4c8d-8b3c-f6b28a58d54f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1737 microversion: 2.1 time: 0.201453 May 19 12:23:13.965784 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 269/591] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:13 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:14.144600 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fd41e806-e7c6-49a1-a807-35927dfd4a5c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:14.145967 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-fd41e806-e7c6-49a1-a807-35927dfd4a5c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:14.155241 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fd41e806-e7c6-49a1-a807-35927dfd4a5c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:14.156043 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fd41e806-e7c6-49a1-a807-35927dfd4a5c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:14.157040 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fd41e806-e7c6-49a1-a807-35927dfd4a5c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:14.157476 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fd41e806-e7c6-49a1-a807-35927dfd4a5c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:14.309842 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fd41e806-e7c6-49a1-a807-35927dfd4a5c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:14.320128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fd41e806-e7c6-49a1-a807-35927dfd4a5c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:14.321639 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fd41e806-e7c6-49a1-a807-35927dfd4a5c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:14.322831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fd41e806-e7c6-49a1-a807-35927dfd4a5c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1738 microversion: 2.20 time: 0.182114 May 19 12:23:14.323592 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 323/592] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:14 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:14.413268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:23:14.413710 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Thu May 19 12:23:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:23:14.985341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-13bcf724-bf6b-4300-a954-8fe12b518f67 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:14.991133 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-13bcf724-bf6b-4300-a954-8fe12b518f67 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:14.999510 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-13bcf724-bf6b-4300-a954-8fe12b518f67 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:15.000269 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-13bcf724-bf6b-4300-a954-8fe12b518f67 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:15.006978 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-13bcf724-bf6b-4300-a954-8fe12b518f67 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:15.006978 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-13bcf724-bf6b-4300-a954-8fe12b518f67 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:15.157105 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-13bcf724-bf6b-4300-a954-8fe12b518f67 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:15.166316 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-13bcf724-bf6b-4300-a954-8fe12b518f67 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1737 microversion: 2.1 time: 0.185300 May 19 12:23:15.167364 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 270/593] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:14 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:15.342656 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8765e7af-d011-4c96-99e6-db219b1e9c8e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:15.343962 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8765e7af-d011-4c96-99e6-db219b1e9c8e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:15.352438 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8765e7af-d011-4c96-99e6-db219b1e9c8e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:15.353217 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8765e7af-d011-4c96-99e6-db219b1e9c8e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:15.354055 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8765e7af-d011-4c96-99e6-db219b1e9c8e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:15.354574 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8765e7af-d011-4c96-99e6-db219b1e9c8e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:15.515378 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8765e7af-d011-4c96-99e6-db219b1e9c8e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:15.524434 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8765e7af-d011-4c96-99e6-db219b1e9c8e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:15.525942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8765e7af-d011-4c96-99e6-db219b1e9c8e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:15.527093 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8765e7af-d011-4c96-99e6-db219b1e9c8e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1738 microversion: 2.20 time: 0.188942 May 19 12:23:15.527642 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 324/594] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:15 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:23:16.185278 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-12675b95-71bb-4781-bd5b-ad919557d64e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:16.185880 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-12675b95-71bb-4781-bd5b-ad919557d64e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:16.192598 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-12675b95-71bb-4781-bd5b-ad919557d64e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:16.193716 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-12675b95-71bb-4781-bd5b-ad919557d64e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:16.194510 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-12675b95-71bb-4781-bd5b-ad919557d64e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:16.194940 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-12675b95-71bb-4781-bd5b-ad919557d64e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:16.329410 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-12675b95-71bb-4781-bd5b-ad919557d64e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:16.337613 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-12675b95-71bb-4781-bd5b-ad919557d64e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1737 microversion: 2.1 time: 0.156585 May 19 12:23:16.338180 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 271/595] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:16 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:16.545531 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-184d1315-f333-42b8-bf5f-20fc8ae08938 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:16.546092 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-184d1315-f333-42b8-bf5f-20fc8ae08938 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:16.554332 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-184d1315-f333-42b8-bf5f-20fc8ae08938 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:16.554778 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-184d1315-f333-42b8-bf5f-20fc8ae08938 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:16.555536 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-184d1315-f333-42b8-bf5f-20fc8ae08938 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:16.555999 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-184d1315-f333-42b8-bf5f-20fc8ae08938 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:16.689772 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-184d1315-f333-42b8-bf5f-20fc8ae08938 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:16.698244 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-184d1315-f333-42b8-bf5f-20fc8ae08938 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:16.699775 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-184d1315-f333-42b8-bf5f-20fc8ae08938 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:16.700945 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-184d1315-f333-42b8-bf5f-20fc8ae08938 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1738 microversion: 2.20 time: 0.159503 May 19 12:23:16.701493 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 325/596] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:16 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:17.354938 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c41a545e-25c9-4892-897e-a9f7dfa3f12d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:17.355818 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c41a545e-25c9-4892-897e-a9f7dfa3f12d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:17.362418 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c41a545e-25c9-4892-897e-a9f7dfa3f12d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:17.362862 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c41a545e-25c9-4892-897e-a9f7dfa3f12d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:17.363633 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c41a545e-25c9-4892-897e-a9f7dfa3f12d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:17.364088 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c41a545e-25c9-4892-897e-a9f7dfa3f12d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:17.544770 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c41a545e-25c9-4892-897e-a9f7dfa3f12d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:17.555762 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c41a545e-25c9-4892-897e-a9f7dfa3f12d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1737 microversion: 2.1 time: 0.204773 May 19 12:23:17.556371 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 272/597] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:17 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:17.719459 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0bf90cfa-b720-4ead-a7d3-07a3f56d668e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:17.720031 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0bf90cfa-b720-4ead-a7d3-07a3f56d668e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:17.728468 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0bf90cfa-b720-4ead-a7d3-07a3f56d668e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:17.728919 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0bf90cfa-b720-4ead-a7d3-07a3f56d668e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:17.729833 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0bf90cfa-b720-4ead-a7d3-07a3f56d668e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:17.730130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0bf90cfa-b720-4ead-a7d3-07a3f56d668e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:17.863411 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0bf90cfa-b720-4ead-a7d3-07a3f56d668e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:17.867045 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:17.872219 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0bf90cfa-b720-4ead-a7d3-07a3f56d668e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:17.873739 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0bf90cfa-b720-4ead-a7d3-07a3f56d668e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:17.874964 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0bf90cfa-b720-4ead-a7d3-07a3f56d668e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1738 microversion: 2.20 time: 0.159538 May 19 12:23:17.875530 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 326/598] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:17 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:18.573412 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-1ab8fb5c-b950-4e35-892d-20f51e904f45 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:18.574017 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-1ab8fb5c-b950-4e35-892d-20f51e904f45 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:18.580553 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1ab8fb5c-b950-4e35-892d-20f51e904f45 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:18.580999 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1ab8fb5c-b950-4e35-892d-20f51e904f45 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:18.581760 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1ab8fb5c-b950-4e35-892d-20f51e904f45 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:18.582190 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1ab8fb5c-b950-4e35-892d-20f51e904f45 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:18.716758 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-1ab8fb5c-b950-4e35-892d-20f51e904f45 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:18.724825 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-1ab8fb5c-b950-4e35-892d-20f51e904f45 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1737 microversion: 2.1 time: 0.155843 May 19 12:23:18.725379 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 273/599] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:18 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:18.894030 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-32a6c23a-560e-4eec-904d-525b3817feb6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:18.894632 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-32a6c23a-560e-4eec-904d-525b3817feb6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:18.901657 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-32a6c23a-560e-4eec-904d-525b3817feb6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:18.902103 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-32a6c23a-560e-4eec-904d-525b3817feb6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:18.902864 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-32a6c23a-560e-4eec-904d-525b3817feb6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:18.903298 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-32a6c23a-560e-4eec-904d-525b3817feb6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:19.033923 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-32a6c23a-560e-4eec-904d-525b3817feb6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:19.042328 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-32a6c23a-560e-4eec-904d-525b3817feb6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:19.243455 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-32a6c23a-560e-4eec-904d-525b3817feb6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:19.243455 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-32a6c23a-560e-4eec-904d-525b3817feb6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1738 microversion: 2.20 time: 0.155362 May 19 12:23:19.243455 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 327/600] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:18 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:19.743867 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-fe4f1155-74ac-4dfd-a6af-c0d420dc8357 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:19.744498 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-fe4f1155-74ac-4dfd-a6af-c0d420dc8357 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:19.751117 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fe4f1155-74ac-4dfd-a6af-c0d420dc8357 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:19.751557 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fe4f1155-74ac-4dfd-a6af-c0d420dc8357 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:19.752339 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fe4f1155-74ac-4dfd-a6af-c0d420dc8357 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:19.752770 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fe4f1155-74ac-4dfd-a6af-c0d420dc8357 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:19.882425 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-fe4f1155-74ac-4dfd-a6af-c0d420dc8357 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:19.890556 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-fe4f1155-74ac-4dfd-a6af-c0d420dc8357 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1737 microversion: 2.1 time: 0.151911 May 19 12:23:19.891221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 274/601] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:19 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:20.063608 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4f9082cf-9263-4ddc-9a75-9b4723be32ce tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:20.064270 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4f9082cf-9263-4ddc-9a75-9b4723be32ce tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:20.071468 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4f9082cf-9263-4ddc-9a75-9b4723be32ce tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:20.071955 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4f9082cf-9263-4ddc-9a75-9b4723be32ce tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:20.072722 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4f9082cf-9263-4ddc-9a75-9b4723be32ce tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:20.073158 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4f9082cf-9263-4ddc-9a75-9b4723be32ce tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:20.209784 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4f9082cf-9263-4ddc-9a75-9b4723be32ce tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:20.218117 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4f9082cf-9263-4ddc-9a75-9b4723be32ce tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:20.219651 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4f9082cf-9263-4ddc-9a75-9b4723be32ce tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:20.220872 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4f9082cf-9263-4ddc-9a75-9b4723be32ce tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1738 microversion: 2.20 time: 0.161196 May 19 12:23:20.221433 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 328/602] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:20 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:20.907943 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-126c09e1-ec13-4a18-b05d-49496a79ac2e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:20.908544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-126c09e1-ec13-4a18-b05d-49496a79ac2e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:20.915455 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-126c09e1-ec13-4a18-b05d-49496a79ac2e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:20.915935 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-126c09e1-ec13-4a18-b05d-49496a79ac2e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:20.916706 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-126c09e1-ec13-4a18-b05d-49496a79ac2e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:20.917141 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-126c09e1-ec13-4a18-b05d-49496a79ac2e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:21.050043 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-126c09e1-ec13-4a18-b05d-49496a79ac2e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:21.058037 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-126c09e1-ec13-4a18-b05d-49496a79ac2e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1717 microversion: 2.1 time: 0.153999 May 19 12:23:21.058601 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 275/603] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:20 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:21.113006 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3639aead-894b-4c7b-ab15-6eb2c71b9def tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:21.113513 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3639aead-894b-4c7b-ab15-6eb2c71b9def tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:21.120222 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3639aead-894b-4c7b-ab15-6eb2c71b9def tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:21.120677 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3639aead-894b-4c7b-ab15-6eb2c71b9def tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:21.121447 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3639aead-894b-4c7b-ab15-6eb2c71b9def tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:21.121884 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3639aead-894b-4c7b-ab15-6eb2c71b9def tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:21.240248 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-89f544f8-9ada-4695-826f-5b699c1443d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:21.240850 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-89f544f8-9ada-4695-826f-5b699c1443d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:21.247829 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-89f544f8-9ada-4695-826f-5b699c1443d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:21.248275 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-89f544f8-9ada-4695-826f-5b699c1443d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:21.249039 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-89f544f8-9ada-4695-826f-5b699c1443d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:21.249651 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-89f544f8-9ada-4695-826f-5b699c1443d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:21.250464 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-3639aead-894b-4c7b-ab15-6eb2c71b9def tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] HTTP exception thrown: Cannot 'detach_volume' instance caffcacb-8fb4-412e-ae78-67570b491068 while it is in vm_state rescued May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3639aead-894b-4c7b-ab15-6eb2c71b9def tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Request method failure captured: May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: DELETE /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/os-volume_attachments/36d4bb2b-45df-464c-a72c-84491cd36bbe HTTP/1.1 May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjV3ba4_uVlBVIvh_bBreMWZSJM2U80SltnInJem3RpmUyDvutWhoUewS7KziAUbwrvECCf0a_6rYJitU_iO6aJz7Ech1mVe-8aUkQ9TDBlP73buFXKQkkHjg5gljrCoIVxKLRParuGEmqFHmsydgfqVGrlueaFfskHreMvIm9Etqy8 May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: b3d651a605fd4dee95797a7ec3896792 May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1292733612 May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:23:21.252118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:23:21.253543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:23:21.253543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1292733612 May 19 12:23:21.253543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: b3d651a605fd4dee95797a7ec3896792 May 19 12:23:21.253543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1292733612 May 19 12:23:21.253543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-ServerRescueNegativeTestJSON-1292733612-project May 19 12:23:21.253543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:23:21.253543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:23:21.253543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: 8e445569dc5641ed962b0ac977850a6c May 19 12:23:21.253543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1292733612-project May 19 12:23:21.253543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:23:21.253543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Cannot 'detach_volume' instance caffcacb-8fb4-412e-ae78-67570b491068 while it is in vm_state rescued May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'server_id': 'caffcacb-8fb4-412e-ae78-67570b491068', 'id': '36d4bb2b-45df-464c-a72c-84491cd36bbe'} May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance caffcacb-8fb4-412e-ae78-67570b491068 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:23:21.254342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:23:21.256138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 19 12:23:21.256138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 12:23:21.256138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 12:23:21.256138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 12:23:21.256138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance caffcacb-8fb4-412e-ae78-67570b491068 while it is in vm_state rescued May 19 12:23:21.256138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:23:21.256138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:23:21.256138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:23:21.256138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:23:21.256138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:23:21.256138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:23:21.256138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:23:21.256138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:23:21.256138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance caffcacb-8fb4-412e-ae78-67570b491068 while it is in vm_state rescued May 19 12:23:21.256138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:23:21.256138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3639aead-894b-4c7b-ab15-6eb2c71b9def tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Returning 409 to user: Cannot 'detach_volume' instance caffcacb-8fb4-412e-ae78-67570b491068 while it is in vm_state rescued {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:23:21.258354 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3639aead-894b-4c7b-ab15-6eb2c71b9def tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "DELETE /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/os-volume_attachments/36d4bb2b-45df-464c-a72c-84491cd36bbe" status: 409 len: 152 microversion: 2.1 time: 0.144783 May 19 12:23:21.258354 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 329/604] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 19 12:23:21 2022] DELETE /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/os-volume_attachments/36d4bb2b-45df-464c-a72c-84491cd36bbe => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 12:23:21.263287 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2d1d8d44-0eef-42ee-b665-6e0f092a205a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:23:21.263839 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2d1d8d44-0eef-42ee-b665-6e0f092a205a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:21.270461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2d1d8d44-0eef-42ee-b665-6e0f092a205a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:21.270906 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2d1d8d44-0eef-42ee-b665-6e0f092a205a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:21.271697 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2d1d8d44-0eef-42ee-b665-6e0f092a205a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:21.272115 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2d1d8d44-0eef-42ee-b665-6e0f092a205a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:21.397503 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-89f544f8-9ada-4695-826f-5b699c1443d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:21.406342 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-89f544f8-9ada-4695-826f-5b699c1443d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:21.407873 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-89f544f8-9ada-4695-826f-5b699c1443d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:21.409031 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-89f544f8-9ada-4695-826f-5b699c1443d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1720 microversion: 2.20 time: 0.172651 May 19 12:23:21.413435 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 276/605] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:21 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:23:21.568726 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2d1d8d44-0eef-42ee-b665-6e0f092a205a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "POST /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/action" status: 202 len: 0 microversion: 2.1 time: 0.308879 May 19 12:23:21.570380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 330/606] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 19 12:23:21 2022] POST /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 12:23:21.578609 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b7197228-66c7-4f71-af28-308ad7c34595 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:21.583916 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-b7197228-66c7-4f71-af28-308ad7c34595 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:21.586447 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b7197228-66c7-4f71-af28-308ad7c34595 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:21.586914 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b7197228-66c7-4f71-af28-308ad7c34595 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:21.587708 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b7197228-66c7-4f71-af28-308ad7c34595 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:21.588198 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b7197228-66c7-4f71-af28-308ad7c34595 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:21.723972 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b7197228-66c7-4f71-af28-308ad7c34595 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:21.732925 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b7197228-66c7-4f71-af28-308ad7c34595 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1725 microversion: 2.1 time: 0.158390 May 19 12:23:21.733648 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 277/607] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:21 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:22.428458 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0b35dbbb-a31d-4a57-80c9-dc17c930fc92 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:22.429297 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0b35dbbb-a31d-4a57-80c9-dc17c930fc92 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:22.435377 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0b35dbbb-a31d-4a57-80c9-dc17c930fc92 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:22.435843 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0b35dbbb-a31d-4a57-80c9-dc17c930fc92 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:22.436605 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0b35dbbb-a31d-4a57-80c9-dc17c930fc92 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:22.437041 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0b35dbbb-a31d-4a57-80c9-dc17c930fc92 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:22.568839 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0b35dbbb-a31d-4a57-80c9-dc17c930fc92 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:22.577860 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0b35dbbb-a31d-4a57-80c9-dc17c930fc92 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:22.579353 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0b35dbbb-a31d-4a57-80c9-dc17c930fc92 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:22.580531 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0b35dbbb-a31d-4a57-80c9-dc17c930fc92 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1720 microversion: 2.20 time: 0.156897 May 19 12:23:22.581201 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 331/608] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:22 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:22.751560 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-7b65f8e4-eb6e-4df4-845d-5edc51a61bd2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:22.752222 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-7b65f8e4-eb6e-4df4-845d-5edc51a61bd2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:22.759800 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7b65f8e4-eb6e-4df4-845d-5edc51a61bd2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:22.760259 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7b65f8e4-eb6e-4df4-845d-5edc51a61bd2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:22.761049 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7b65f8e4-eb6e-4df4-845d-5edc51a61bd2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:22.761493 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7b65f8e4-eb6e-4df4-845d-5edc51a61bd2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:22.765710 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=100 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:22.891150 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-7b65f8e4-eb6e-4df4-845d-5edc51a61bd2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:22.899173 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-7b65f8e4-eb6e-4df4-845d-5edc51a61bd2 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1725 microversion: 2.1 time: 0.151439 May 19 12:23:22.899735 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 278/609] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:22 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:23.313857 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-f043b149-cd56-4834-b0cd-9bd9811a83a8 req-2c3f71d1-9236-44ca-9ced-bc038db93415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aedab7fb-ae90-48e1-8745-626d60c88a1a", "name": "network-vif-unplugged", "status": "completed", "tag": "5fc43837-dd78-4f9a-ab74-cfe109a4819d"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:23:23.322184 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-f043b149-cd56-4834-b0cd-9bd9811a83a8 req-2c3f71d1-9236-44ca-9ced-bc038db93415 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:23.322658 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-f043b149-cd56-4834-b0cd-9bd9811a83a8 req-2c3f71d1-9236-44ca-9ced-bc038db93415 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:23.333773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-f043b149-cd56-4834-b0cd-9bd9811a83a8 req-2c3f71d1-9236-44ca-9ced-bc038db93415 service nova] Creating event network-vif-unplugged:5fc43837-dd78-4f9a-ab74-cfe109a4819d for instance aedab7fb-ae90-48e1-8745-626d60c88a1a on hv-cinder-80475 May 19 12:23:23.339307 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-f043b149-cd56-4834-b0cd-9bd9811a83a8 req-2c3f71d1-9236-44ca-9ced-bc038db93415 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029197 May 19 12:23:23.339919 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 332/610] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:23:23.600283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-11c4bc43-2828-4419-bca6-b33d19510ab9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:23.601894 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-11c4bc43-2828-4419-bca6-b33d19510ab9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:23.607637 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-11c4bc43-2828-4419-bca6-b33d19510ab9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:23.608108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-11c4bc43-2828-4419-bca6-b33d19510ab9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:23.608904 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-11c4bc43-2828-4419-bca6-b33d19510ab9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:23.609587 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-11c4bc43-2828-4419-bca6-b33d19510ab9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:23.742740 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-11c4bc43-2828-4419-bca6-b33d19510ab9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:23.751003 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-11c4bc43-2828-4419-bca6-b33d19510ab9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:23.752924 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-11c4bc43-2828-4419-bca6-b33d19510ab9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:23.754100 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-11c4bc43-2828-4419-bca6-b33d19510ab9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1720 microversion: 2.20 time: 0.157905 May 19 12:23:23.754654 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 279/611] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:23 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:23.918018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1e63f750-70b4-4fef-bf1f-fa866d745a48 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:23.918739 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1e63f750-70b4-4fef-bf1f-fa866d745a48 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:23.936100 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1e63f750-70b4-4fef-bf1f-fa866d745a48 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:23.936100 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1e63f750-70b4-4fef-bf1f-fa866d745a48 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:23.936100 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1e63f750-70b4-4fef-bf1f-fa866d745a48 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:23.936100 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1e63f750-70b4-4fef-bf1f-fa866d745a48 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:24.072373 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1e63f750-70b4-4fef-bf1f-fa866d745a48 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:24.081143 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1e63f750-70b4-4fef-bf1f-fa866d745a48 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1725 microversion: 2.1 time: 0.167772 May 19 12:23:24.081708 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 333/612] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:23 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:24.772391 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6e3e1ae5-e15b-409c-8516-c3ac1b2f3d44 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:24.772940 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6e3e1ae5-e15b-409c-8516-c3ac1b2f3d44 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:24.779416 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6e3e1ae5-e15b-409c-8516-c3ac1b2f3d44 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:24.779894 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6e3e1ae5-e15b-409c-8516-c3ac1b2f3d44 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:24.780649 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6e3e1ae5-e15b-409c-8516-c3ac1b2f3d44 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:24.781078 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6e3e1ae5-e15b-409c-8516-c3ac1b2f3d44 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:24.908518 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6e3e1ae5-e15b-409c-8516-c3ac1b2f3d44 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:24.917307 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6e3e1ae5-e15b-409c-8516-c3ac1b2f3d44 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:24.918806 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6e3e1ae5-e15b-409c-8516-c3ac1b2f3d44 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:24.919972 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6e3e1ae5-e15b-409c-8516-c3ac1b2f3d44 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1723 microversion: 2.20 time: 0.151569 May 19 12:23:24.920552 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 280/613] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:24 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:24.938523 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0b1637ac-f863-4ee9-a78e-558e77e46300 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80fe4a37-3bb1-490c-ba21-8ab8ff831f66"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:23:24.939630 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0b1637ac-f863-4ee9-a78e-558e77e46300 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:24.946327 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0b1637ac-f863-4ee9-a78e-558e77e46300 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:24.946773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0b1637ac-f863-4ee9-a78e-558e77e46300 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:24.947530 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0b1637ac-f863-4ee9-a78e-558e77e46300 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:24.947995 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0b1637ac-f863-4ee9-a78e-558e77e46300 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:25.099893 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d1d4922a-9f00-4a88-bf4d-ff8b4ab4a508 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:25.101116 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d1d4922a-9f00-4a88-bf4d-ff8b4ab4a508 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:25.107959 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d1d4922a-9f00-4a88-bf4d-ff8b4ab4a508 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:25.108412 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d1d4922a-9f00-4a88-bf4d-ff8b4ab4a508 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:25.109432 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d1d4922a-9f00-4a88-bf4d-ff8b4ab4a508 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:25.109973 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d1d4922a-9f00-4a88-bf4d-ff8b4ab4a508 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:25.260355 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d1d4922a-9f00-4a88-bf4d-ff8b4ab4a508 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:25.268603 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d1d4922a-9f00-4a88-bf4d-ff8b4ab4a508 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1725 microversion: 2.1 time: 0.172562 May 19 12:23:25.269184 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 281/614] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:25 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:23:26.197930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0b1637ac-f863-4ee9-a78e-558e77e46300 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "POST /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.263194 May 19 12:23:26.199372 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 334/615] 10.222.0.23 () {62 vars in 1363 bytes} [Thu May 19 12:23:24 2022] POST /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/os-volume_attachments => generated 188 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:23:26.286734 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f20d4e47-0921-406e-b58c-4e655951cfe0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:26.287350 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f20d4e47-0921-406e-b58c-4e655951cfe0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:26.294745 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f20d4e47-0921-406e-b58c-4e655951cfe0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:26.295199 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f20d4e47-0921-406e-b58c-4e655951cfe0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:26.296022 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f20d4e47-0921-406e-b58c-4e655951cfe0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:26.296460 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f20d4e47-0921-406e-b58c-4e655951cfe0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:26.317366 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e54bfc1c-9579-44ea-b0da-acaf1324e23f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:23:26.317931 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e54bfc1c-9579-44ea-b0da-acaf1324e23f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:26.324046 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e54bfc1c-9579-44ea-b0da-acaf1324e23f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:26.324492 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e54bfc1c-9579-44ea-b0da-acaf1324e23f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:26.325248 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e54bfc1c-9579-44ea-b0da-acaf1324e23f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:26.325677 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e54bfc1c-9579-44ea-b0da-acaf1324e23f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:26.437304 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f20d4e47-0921-406e-b58c-4e655951cfe0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:26.445704 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f20d4e47-0921-406e-b58c-4e655951cfe0 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1725 microversion: 2.1 time: 0.162578 May 19 12:23:26.446297 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 282/616] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:26 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:26.674649 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e54bfc1c-9579-44ea-b0da-acaf1324e23f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "POST /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/action" status: 202 len: 0 microversion: 2.20 time: 0.360940 May 19 12:23:26.675393 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 335/617] 10.222.0.23 () {62 vars in 1318 bytes} [Thu May 19 12:23:26 2022] POST /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 19 12:23:26.684307 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-200ef174-d07f-43a0-ae59-09b3febff8ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:26.684914 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-200ef174-d07f-43a0-ae59-09b3febff8ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:26.691193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-200ef174-d07f-43a0-ae59-09b3febff8ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:26.691636 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-200ef174-d07f-43a0-ae59-09b3febff8ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:26.692446 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-200ef174-d07f-43a0-ae59-09b3febff8ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:26.692877 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-200ef174-d07f-43a0-ae59-09b3febff8ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:26.830635 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-200ef174-d07f-43a0-ae59-09b3febff8ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:26.841909 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-200ef174-d07f-43a0-ae59-09b3febff8ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:26.843555 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-200ef174-d07f-43a0-ae59-09b3febff8ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:26.844828 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-200ef174-d07f-43a0-ae59-09b3febff8ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1809 microversion: 2.20 time: 0.164495 May 19 12:23:26.845460 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 283/618] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:26 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:23:27.463435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0e2873c0-3f07-4640-a9a9-5c0818ceac01 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:27.464663 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0e2873c0-3f07-4640-a9a9-5c0818ceac01 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:27.471205 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e2873c0-3f07-4640-a9a9-5c0818ceac01 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:27.471664 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e2873c0-3f07-4640-a9a9-5c0818ceac01 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:27.472474 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e2873c0-3f07-4640-a9a9-5c0818ceac01 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:27.472916 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e2873c0-3f07-4640-a9a9-5c0818ceac01 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:27.623707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0e2873c0-3f07-4640-a9a9-5c0818ceac01 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:27.634385 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0e2873c0-3f07-4640-a9a9-5c0818ceac01 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1731 microversion: 2.1 time: 0.175625 May 19 12:23:27.638082 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 336/619] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:27 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:27.652728 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ac52e3c8-8166-42dd-9c13-b19c8bcd1d27 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:27.653929 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ac52e3c8-8166-42dd-9c13-b19c8bcd1d27 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:27.659761 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ac52e3c8-8166-42dd-9c13-b19c8bcd1d27 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:27.660022 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ac52e3c8-8166-42dd-9c13-b19c8bcd1d27 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:27.660809 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ac52e3c8-8166-42dd-9c13-b19c8bcd1d27 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:27.661256 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ac52e3c8-8166-42dd-9c13-b19c8bcd1d27 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:27.751813 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ac52e3c8-8166-42dd-9c13-b19c8bcd1d27 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104223 May 19 12:23:27.752550 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 284/620] 10.222.0.23 () {58 vars in 1274 bytes} [Thu May 19 12:23:27 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:23:27.864839 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f4f27fb1-fe7d-4ebf-8410-14851cc5c4bf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:27.865479 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f4f27fb1-fe7d-4ebf-8410-14851cc5c4bf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:27.872643 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4f27fb1-fe7d-4ebf-8410-14851cc5c4bf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:27.873095 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4f27fb1-fe7d-4ebf-8410-14851cc5c4bf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:27.873873 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4f27fb1-fe7d-4ebf-8410-14851cc5c4bf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:27.874312 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4f27fb1-fe7d-4ebf-8410-14851cc5c4bf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:28.127149 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f4f27fb1-fe7d-4ebf-8410-14851cc5c4bf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:28.136294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f4f27fb1-fe7d-4ebf-8410-14851cc5c4bf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:28.137801 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f4f27fb1-fe7d-4ebf-8410-14851cc5c4bf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:28.138976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f4f27fb1-fe7d-4ebf-8410-14851cc5c4bf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1749 microversion: 2.20 time: 0.278076 May 19 12:23:28.139533 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 337/621] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:27 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1749 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:29.148819 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-b28467de-d7cd-48bb-a501-731d5b4242a5 req-e0e9b94a-9118-4e5c-8d3f-4420d0002fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caffcacb-8fb4-412e-ae78-67570b491068", "tag": "413f04d8-4ef0-4bef-8ee6-725aaa428db9"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:23:29.157711 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-b28467de-d7cd-48bb-a501-731d5b4242a5 req-e0e9b94a-9118-4e5c-8d3f-4420d0002fc0 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:29.161132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-b28467de-d7cd-48bb-a501-731d5b4242a5 req-e0e9b94a-9118-4e5c-8d3f-4420d0002fc0 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:29.161302 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-33446c81-ab8a-4438-94f6-7660d83c0f96 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:29.161302 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-33446c81-ab8a-4438-94f6-7660d83c0f96 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:29.167471 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33446c81-ab8a-4438-94f6-7660d83c0f96 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:29.168127 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33446c81-ab8a-4438-94f6-7660d83c0f96 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:29.168895 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33446c81-ab8a-4438-94f6-7660d83c0f96 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:29.169497 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33446c81-ab8a-4438-94f6-7660d83c0f96 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:29.171097 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-b28467de-d7cd-48bb-a501-731d5b4242a5 req-e0e9b94a-9118-4e5c-8d3f-4420d0002fc0 service nova] Creating event network-changed:413f04d8-4ef0-4bef-8ee6-725aaa428db9 for instance caffcacb-8fb4-412e-ae78-67570b491068 on hv-cinder-80475 May 19 12:23:29.176436 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-b28467de-d7cd-48bb-a501-731d5b4242a5 req-e0e9b94a-9118-4e5c-8d3f-4420d0002fc0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092001 May 19 12:23:29.177273 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 285/622] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:23:29.312914 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-33446c81-ab8a-4438-94f6-7660d83c0f96 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:29.322426 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-33446c81-ab8a-4438-94f6-7660d83c0f96 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:29.324050 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-33446c81-ab8a-4438-94f6-7660d83c0f96 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:29.325284 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-33446c81-ab8a-4438-94f6-7660d83c0f96 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1751 microversion: 2.20 time: 0.170840 May 19 12:23:29.325849 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 338/623] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:29 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:30.346092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9fc27c92-d9c9-4cf3-a044-2f915aee3c85 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:30.346830 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9fc27c92-d9c9-4cf3-a044-2f915aee3c85 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:30.354050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9fc27c92-d9c9-4cf3-a044-2f915aee3c85 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:30.354500 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9fc27c92-d9c9-4cf3-a044-2f915aee3c85 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:30.355268 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9fc27c92-d9c9-4cf3-a044-2f915aee3c85 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:30.355710 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9fc27c92-d9c9-4cf3-a044-2f915aee3c85 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:30.488963 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9fc27c92-d9c9-4cf3-a044-2f915aee3c85 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:30.497656 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9fc27c92-d9c9-4cf3-a044-2f915aee3c85 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:30.499305 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9fc27c92-d9c9-4cf3-a044-2f915aee3c85 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:30.500485 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9fc27c92-d9c9-4cf3-a044-2f915aee3c85 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1751 microversion: 2.20 time: 0.159411 May 19 12:23:30.501027 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 286/624] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:30 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:31.191478 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-9dd4ec94-a139-49c3-a01c-a7fb03b13763 req-34f68d57-22ee-4f68-9009-30fd5fdb7612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caffcacb-8fb4-412e-ae78-67570b491068", "tag": "413f04d8-4ef0-4bef-8ee6-725aaa428db9"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:23:31.201465 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-9dd4ec94-a139-49c3-a01c-a7fb03b13763 req-34f68d57-22ee-4f68-9009-30fd5fdb7612 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:31.201839 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-9dd4ec94-a139-49c3-a01c-a7fb03b13763 req-34f68d57-22ee-4f68-9009-30fd5fdb7612 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:31.213406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-9dd4ec94-a139-49c3-a01c-a7fb03b13763 req-34f68d57-22ee-4f68-9009-30fd5fdb7612 service nova] Creating event network-changed:413f04d8-4ef0-4bef-8ee6-725aaa428db9 for instance caffcacb-8fb4-412e-ae78-67570b491068 on hv-cinder-80475 May 19 12:23:31.218589 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-9dd4ec94-a139-49c3-a01c-a7fb03b13763 req-34f68d57-22ee-4f68-9009-30fd5fdb7612 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030668 May 19 12:23:31.219190 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 339/625] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:23:31.519230 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a07ec1fd-e6c7-492f-9cdc-ef05cb381197 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:31.519910 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a07ec1fd-e6c7-492f-9cdc-ef05cb381197 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:31.527035 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a07ec1fd-e6c7-492f-9cdc-ef05cb381197 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:31.527495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a07ec1fd-e6c7-492f-9cdc-ef05cb381197 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:31.528325 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a07ec1fd-e6c7-492f-9cdc-ef05cb381197 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:31.528918 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a07ec1fd-e6c7-492f-9cdc-ef05cb381197 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:31.665987 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a07ec1fd-e6c7-492f-9cdc-ef05cb381197 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:31.674522 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a07ec1fd-e6c7-492f-9cdc-ef05cb381197 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:31.676040 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a07ec1fd-e6c7-492f-9cdc-ef05cb381197 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:31.682909 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a07ec1fd-e6c7-492f-9cdc-ef05cb381197 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.162110 May 19 12:23:31.682909 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 287/626] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:31 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:32.700749 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b5f03171-2620-420f-9885-91145506f59c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:32.701445 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b5f03171-2620-420f-9885-91145506f59c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:32.707727 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b5f03171-2620-420f-9885-91145506f59c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:32.708210 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b5f03171-2620-420f-9885-91145506f59c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:32.708974 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b5f03171-2620-420f-9885-91145506f59c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:32.709438 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b5f03171-2620-420f-9885-91145506f59c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:32.714426 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:32.841686 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b5f03171-2620-420f-9885-91145506f59c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:32.849858 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b5f03171-2620-420f-9885-91145506f59c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:32.851894 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b5f03171-2620-420f-9885-91145506f59c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:32.853045 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b5f03171-2620-420f-9885-91145506f59c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.157187 May 19 12:23:32.853599 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 340/627] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:32 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:33.871886 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c87da9fb-e7b2-45dc-8fca-f62a15856bf3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:33.872507 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c87da9fb-e7b2-45dc-8fca-f62a15856bf3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:33.878657 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c87da9fb-e7b2-45dc-8fca-f62a15856bf3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:33.879099 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c87da9fb-e7b2-45dc-8fca-f62a15856bf3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:33.879882 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c87da9fb-e7b2-45dc-8fca-f62a15856bf3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:33.880310 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c87da9fb-e7b2-45dc-8fca-f62a15856bf3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:34.024983 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c87da9fb-e7b2-45dc-8fca-f62a15856bf3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:34.034219 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c87da9fb-e7b2-45dc-8fca-f62a15856bf3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:34.035728 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c87da9fb-e7b2-45dc-8fca-f62a15856bf3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:34.036924 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c87da9fb-e7b2-45dc-8fca-f62a15856bf3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.169098 May 19 12:23:34.037486 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 288/628] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:33 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:35.056506 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fc9a397b-b518-47b4-9a44-2ece235a0f34 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:35.057105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-fc9a397b-b518-47b4-9a44-2ece235a0f34 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:35.063704 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fc9a397b-b518-47b4-9a44-2ece235a0f34 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:35.064175 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fc9a397b-b518-47b4-9a44-2ece235a0f34 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:35.064933 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fc9a397b-b518-47b4-9a44-2ece235a0f34 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:35.065361 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fc9a397b-b518-47b4-9a44-2ece235a0f34 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:35.206606 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fc9a397b-b518-47b4-9a44-2ece235a0f34 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:35.216432 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fc9a397b-b518-47b4-9a44-2ece235a0f34 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:35.217912 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fc9a397b-b518-47b4-9a44-2ece235a0f34 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:35.219090 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fc9a397b-b518-47b4-9a44-2ece235a0f34 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.167494 May 19 12:23:35.219643 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 341/629] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:35 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:36.279032 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-98afc03e-d245-49d9-9b5c-fb499587fe03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:36.279032 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-98afc03e-d245-49d9-9b5c-fb499587fe03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:36.279032 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=54 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:36.279032 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-98afc03e-d245-49d9-9b5c-fb499587fe03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:36.279997 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-98afc03e-d245-49d9-9b5c-fb499587fe03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:36.279997 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-98afc03e-d245-49d9-9b5c-fb499587fe03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:36.279997 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-98afc03e-d245-49d9-9b5c-fb499587fe03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:36.387719 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-98afc03e-d245-49d9-9b5c-fb499587fe03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:36.396164 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-98afc03e-d245-49d9-9b5c-fb499587fe03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:36.398381 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-98afc03e-d245-49d9-9b5c-fb499587fe03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:36.399641 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-98afc03e-d245-49d9-9b5c-fb499587fe03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.165127 May 19 12:23:36.400221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 289/630] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:36 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:37.420109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1e74ded5-665c-4249-b429-bf8aa1e472fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:37.420698 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1e74ded5-665c-4249-b429-bf8aa1e472fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:37.426773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1e74ded5-665c-4249-b429-bf8aa1e472fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:37.427220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1e74ded5-665c-4249-b429-bf8aa1e472fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:37.428165 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1e74ded5-665c-4249-b429-bf8aa1e472fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:37.429346 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1e74ded5-665c-4249-b429-bf8aa1e472fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:37.562084 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1e74ded5-665c-4249-b429-bf8aa1e472fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:37.573308 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1e74ded5-665c-4249-b429-bf8aa1e472fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:37.575008 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1e74ded5-665c-4249-b429-bf8aa1e472fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:37.576215 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1e74ded5-665c-4249-b429-bf8aa1e472fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.161101 May 19 12:23:37.578981 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 342/631] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:37 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:38.595055 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-7310aa7a-2d63-4af3-b140-fde43c7a7cee tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:38.595685 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-7310aa7a-2d63-4af3-b140-fde43c7a7cee tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:38.602779 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7310aa7a-2d63-4af3-b140-fde43c7a7cee tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:38.603221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7310aa7a-2d63-4af3-b140-fde43c7a7cee tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:38.604072 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7310aa7a-2d63-4af3-b140-fde43c7a7cee tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:38.604505 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7310aa7a-2d63-4af3-b140-fde43c7a7cee tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:38.752396 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-7310aa7a-2d63-4af3-b140-fde43c7a7cee tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:38.767059 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-7310aa7a-2d63-4af3-b140-fde43c7a7cee tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:38.768757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-7310aa7a-2d63-4af3-b140-fde43c7a7cee tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:38.770753 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-7310aa7a-2d63-4af3-b140-fde43c7a7cee tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.179806 May 19 12:23:38.772246 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 290/632] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:38 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:39.800927 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-33fd19fa-bf1c-4603-b565-c2f768c898c2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:39.800927 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-33fd19fa-bf1c-4603-b565-c2f768c898c2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:39.807153 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33fd19fa-bf1c-4603-b565-c2f768c898c2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:39.807832 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33fd19fa-bf1c-4603-b565-c2f768c898c2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:39.808813 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33fd19fa-bf1c-4603-b565-c2f768c898c2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:39.809329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33fd19fa-bf1c-4603-b565-c2f768c898c2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:39.954248 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-33fd19fa-bf1c-4603-b565-c2f768c898c2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:39.962982 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-33fd19fa-bf1c-4603-b565-c2f768c898c2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:39.964535 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-33fd19fa-bf1c-4603-b565-c2f768c898c2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:39.965699 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-33fd19fa-bf1c-4603-b565-c2f768c898c2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.172726 May 19 12:23:39.966263 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 343/633] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:39 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:40.989975 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a133b8d3-919e-40b7-834e-ef49b61c34ed tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:40.989975 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a133b8d3-919e-40b7-834e-ef49b61c34ed tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:40.995080 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a133b8d3-919e-40b7-834e-ef49b61c34ed tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:40.995516 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a133b8d3-919e-40b7-834e-ef49b61c34ed tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:40.996437 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a133b8d3-919e-40b7-834e-ef49b61c34ed tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:40.996782 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a133b8d3-919e-40b7-834e-ef49b61c34ed tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:41.133989 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a133b8d3-919e-40b7-834e-ef49b61c34ed tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:41.142559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a133b8d3-919e-40b7-834e-ef49b61c34ed tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:41.144120 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a133b8d3-919e-40b7-834e-ef49b61c34ed tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:41.145289 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a133b8d3-919e-40b7-834e-ef49b61c34ed tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.163368 May 19 12:23:41.146047 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 291/634] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:40 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:42.170595 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-17075fd8-2d66-492c-8854-c008f80b946e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:42.171181 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-17075fd8-2d66-492c-8854-c008f80b946e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:42.177785 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17075fd8-2d66-492c-8854-c008f80b946e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:42.178913 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17075fd8-2d66-492c-8854-c008f80b946e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:42.179682 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17075fd8-2d66-492c-8854-c008f80b946e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:42.180207 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17075fd8-2d66-492c-8854-c008f80b946e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:42.331215 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-17075fd8-2d66-492c-8854-c008f80b946e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:42.341437 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-17075fd8-2d66-492c-8854-c008f80b946e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:42.342946 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-17075fd8-2d66-492c-8854-c008f80b946e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:42.344247 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-17075fd8-2d66-492c-8854-c008f80b946e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.177614 May 19 12:23:42.345023 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 344/635] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:42 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:43.362851 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6fc6a9c3-0b11-45c8-81a9-67d34e139f10 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:43.363447 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6fc6a9c3-0b11-45c8-81a9-67d34e139f10 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:43.370562 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6fc6a9c3-0b11-45c8-81a9-67d34e139f10 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:43.371013 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6fc6a9c3-0b11-45c8-81a9-67d34e139f10 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:43.371800 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6fc6a9c3-0b11-45c8-81a9-67d34e139f10 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:43.372240 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6fc6a9c3-0b11-45c8-81a9-67d34e139f10 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:43.505327 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6fc6a9c3-0b11-45c8-81a9-67d34e139f10 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:43.514562 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6fc6a9c3-0b11-45c8-81a9-67d34e139f10 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:43.516092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6fc6a9c3-0b11-45c8-81a9-67d34e139f10 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:43.517245 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6fc6a9c3-0b11-45c8-81a9-67d34e139f10 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.158571 May 19 12:23:43.517797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 292/636] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:43 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:44.539931 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-36ba48e5-489f-44e9-ab7f-6596a2c74d4f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:44.540910 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-36ba48e5-489f-44e9-ab7f-6596a2c74d4f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:44.544658 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=48 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:44.549867 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-36ba48e5-489f-44e9-ab7f-6596a2c74d4f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:44.550311 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-36ba48e5-489f-44e9-ab7f-6596a2c74d4f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:44.551418 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-36ba48e5-489f-44e9-ab7f-6596a2c74d4f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:44.551920 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-36ba48e5-489f-44e9-ab7f-6596a2c74d4f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:44.710631 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-36ba48e5-489f-44e9-ab7f-6596a2c74d4f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:44.719335 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-36ba48e5-489f-44e9-ab7f-6596a2c74d4f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:44.720848 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-36ba48e5-489f-44e9-ab7f-6596a2c74d4f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:44.722000 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-36ba48e5-489f-44e9-ab7f-6596a2c74d4f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.189399 May 19 12:23:44.722552 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 345/637] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:44 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:45.741265 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f9aa4181-06c3-4ba6-93c5-49f8d3d70500 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:45.741875 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f9aa4181-06c3-4ba6-93c5-49f8d3d70500 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:45.748496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f9aa4181-06c3-4ba6-93c5-49f8d3d70500 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:45.748947 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f9aa4181-06c3-4ba6-93c5-49f8d3d70500 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:45.749742 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f9aa4181-06c3-4ba6-93c5-49f8d3d70500 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:45.750181 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f9aa4181-06c3-4ba6-93c5-49f8d3d70500 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:45.889804 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f9aa4181-06c3-4ba6-93c5-49f8d3d70500 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:45.899662 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f9aa4181-06c3-4ba6-93c5-49f8d3d70500 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:45.901189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f9aa4181-06c3-4ba6-93c5-49f8d3d70500 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:45.902337 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f9aa4181-06c3-4ba6-93c5-49f8d3d70500 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.165048 May 19 12:23:45.902891 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 293/638] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:45 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:46.921003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-536fd2be-134b-43a2-81e3-25e8bc1c0a0f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:46.921853 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-536fd2be-134b-43a2-81e3-25e8bc1c0a0f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:46.929175 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-536fd2be-134b-43a2-81e3-25e8bc1c0a0f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:46.930144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-536fd2be-134b-43a2-81e3-25e8bc1c0a0f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:46.931092 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-536fd2be-134b-43a2-81e3-25e8bc1c0a0f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:46.931737 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-536fd2be-134b-43a2-81e3-25e8bc1c0a0f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:47.081117 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-536fd2be-134b-43a2-81e3-25e8bc1c0a0f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:47.089943 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-536fd2be-134b-43a2-81e3-25e8bc1c0a0f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:47.091457 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-536fd2be-134b-43a2-81e3-25e8bc1c0a0f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:47.092659 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-536fd2be-134b-43a2-81e3-25e8bc1c0a0f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.176347 May 19 12:23:47.093238 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 346/639] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:46 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:47.698502 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b12e55d5-7339-43f7-a713-d245f443d65a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:47.699036 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-b12e55d5-7339-43f7-a713-d245f443d65a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:47.705580 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b12e55d5-7339-43f7-a713-d245f443d65a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:47.706055 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b12e55d5-7339-43f7-a713-d245f443d65a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:47.706823 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b12e55d5-7339-43f7-a713-d245f443d65a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:47.707264 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b12e55d5-7339-43f7-a713-d245f443d65a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:47.834823 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.objects.instance [None req-b12e55d5-7339-43f7-a713-d245f443d65a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lazy-loading 'services' on Instance uuid 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 {{(pid=117964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:23:48.112231 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-996faa16-8f2d-48f2-a157-1494fde85626 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:48.112832 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-996faa16-8f2d-48f2-a157-1494fde85626 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:48.120389 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-996faa16-8f2d-48f2-a157-1494fde85626 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:48.120837 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-996faa16-8f2d-48f2-a157-1494fde85626 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:48.121594 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-996faa16-8f2d-48f2-a157-1494fde85626 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:48.122105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-996faa16-8f2d-48f2-a157-1494fde85626 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:48.257205 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-996faa16-8f2d-48f2-a157-1494fde85626 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:48.265790 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-996faa16-8f2d-48f2-a157-1494fde85626 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:48.267287 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-996faa16-8f2d-48f2-a157-1494fde85626 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:48.268530 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-996faa16-8f2d-48f2-a157-1494fde85626 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.160570 May 19 12:23:48.269224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 347/640] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:48 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:23:48.301433 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b12e55d5-7339-43f7-a713-d245f443d65a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0/os-volume_attachments/6f07496e-cbbc-4120-b441-1166ffbdd1d3" status: 202 len: 0 microversion: 2.1 time: 0.734553 May 19 12:23:48.302062 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 294/641] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 19 12:23:47 2022] DELETE /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0/os-volume_attachments/6f07496e-cbbc-4120-b441-1166ffbdd1d3 => generated 0 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:23:49.288488 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c5707af3-6db0-48d0-86c7-5371d9103d49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:49.289058 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c5707af3-6db0-48d0-86c7-5371d9103d49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:49.296120 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c5707af3-6db0-48d0-86c7-5371d9103d49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:49.296577 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c5707af3-6db0-48d0-86c7-5371d9103d49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:49.297374 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c5707af3-6db0-48d0-86c7-5371d9103d49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:49.297816 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c5707af3-6db0-48d0-86c7-5371d9103d49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:49.439421 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c5707af3-6db0-48d0-86c7-5371d9103d49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:49.448930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c5707af3-6db0-48d0-86c7-5371d9103d49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:49.450457 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c5707af3-6db0-48d0-86c7-5371d9103d49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:49.451614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c5707af3-6db0-48d0-86c7-5371d9103d49 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.168257 May 19 12:23:49.452200 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 348/642] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:49 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:50.471036 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f4cccb41-7308-4c4d-a8c9-e339bb842024 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:50.471733 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f4cccb41-7308-4c4d-a8c9-e339bb842024 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:50.479112 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f4cccb41-7308-4c4d-a8c9-e339bb842024 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:50.479562 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f4cccb41-7308-4c4d-a8c9-e339bb842024 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:50.480371 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f4cccb41-7308-4c4d-a8c9-e339bb842024 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:50.480806 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f4cccb41-7308-4c4d-a8c9-e339bb842024 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:50.488561 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:50.621363 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f4cccb41-7308-4c4d-a8c9-e339bb842024 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:50.630299 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f4cccb41-7308-4c4d-a8c9-e339bb842024 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:50.631971 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f4cccb41-7308-4c4d-a8c9-e339bb842024 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:50.633240 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f4cccb41-7308-4c4d-a8c9-e339bb842024 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.166520 May 19 12:23:50.633694 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 295/643] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:50 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:51.651647 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-06d21dd2-fb60-4356-8886-6e05aa63c32b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:51.652282 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-06d21dd2-fb60-4356-8886-6e05aa63c32b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:51.658773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-06d21dd2-fb60-4356-8886-6e05aa63c32b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:51.659218 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-06d21dd2-fb60-4356-8886-6e05aa63c32b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:51.660000 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-06d21dd2-fb60-4356-8886-6e05aa63c32b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:51.660438 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-06d21dd2-fb60-4356-8886-6e05aa63c32b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:51.791156 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-06d21dd2-fb60-4356-8886-6e05aa63c32b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:51.799902 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-06d21dd2-fb60-4356-8886-6e05aa63c32b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:51.801609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-06d21dd2-fb60-4356-8886-6e05aa63c32b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:51.802953 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-06d21dd2-fb60-4356-8886-6e05aa63c32b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.155131 May 19 12:23:51.803563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 349/644] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:51 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:52.821740 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-85d70bde-8035-4021-99e5-6646fd36cb7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:52.822395 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-85d70bde-8035-4021-99e5-6646fd36cb7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:52.829011 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-85d70bde-8035-4021-99e5-6646fd36cb7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:52.829450 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-85d70bde-8035-4021-99e5-6646fd36cb7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:52.830206 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-85d70bde-8035-4021-99e5-6646fd36cb7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:52.830651 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-85d70bde-8035-4021-99e5-6646fd36cb7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:52.966668 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-85d70bde-8035-4021-99e5-6646fd36cb7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:52.975323 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-85d70bde-8035-4021-99e5-6646fd36cb7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:52.976851 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-85d70bde-8035-4021-99e5-6646fd36cb7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:52.977993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-85d70bde-8035-4021-99e5-6646fd36cb7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.160473 May 19 12:23:52.978533 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 296/645] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:52 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:53.997098 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ae1faff7-6170-4de1-9a68-8c9bbf50c1d8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:53.997709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ae1faff7-6170-4de1-9a68-8c9bbf50c1d8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:54.004387 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae1faff7-6170-4de1-9a68-8c9bbf50c1d8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:54.004831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae1faff7-6170-4de1-9a68-8c9bbf50c1d8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:54.005581 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae1faff7-6170-4de1-9a68-8c9bbf50c1d8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:54.006680 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae1faff7-6170-4de1-9a68-8c9bbf50c1d8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:54.138270 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ae1faff7-6170-4de1-9a68-8c9bbf50c1d8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:54.147516 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ae1faff7-6170-4de1-9a68-8c9bbf50c1d8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:54.149230 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ae1faff7-6170-4de1-9a68-8c9bbf50c1d8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:54.150304 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ae1faff7-6170-4de1-9a68-8c9bbf50c1d8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.157592 May 19 12:23:54.150833 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 350/646] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:53 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:55.169120 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-df97c582-60b9-4e66-9542-ede26b9cd1d2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:55.169728 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-df97c582-60b9-4e66-9542-ede26b9cd1d2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:55.176877 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-df97c582-60b9-4e66-9542-ede26b9cd1d2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:55.177324 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-df97c582-60b9-4e66-9542-ede26b9cd1d2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:55.178237 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-df97c582-60b9-4e66-9542-ede26b9cd1d2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:55.178712 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-df97c582-60b9-4e66-9542-ede26b9cd1d2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:55.312976 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-df97c582-60b9-4e66-9542-ede26b9cd1d2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:55.322265 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-df97c582-60b9-4e66-9542-ede26b9cd1d2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:55.323999 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-df97c582-60b9-4e66-9542-ede26b9cd1d2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:55.325151 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-df97c582-60b9-4e66-9542-ede26b9cd1d2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.160341 May 19 12:23:55.325699 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 297/647] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:55 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:23:55.747444 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9f9ea34e-b1ef-42fa-929c-42d5d60fd7d5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:23:55.754434 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9f9ea34e-b1ef-42fa-929c-42d5d60fd7d5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:55.754878 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9f9ea34e-b1ef-42fa-929c-42d5d60fd7d5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:55.781398 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9f9ea34e-b1ef-42fa-929c-42d5d60fd7d5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Going to try to stop instance {{(pid=117963) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 12:23:56.045506 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9f9ea34e-b1ef-42fa-929c-42d5d60fd7d5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "POST /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0/action" status: 202 len: 0 microversion: 2.1 time: 0.301798 May 19 12:23:56.046182 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 351/648] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 19 12:23:55 2022] POST /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:23:56.055061 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e4989af2-dafb-494e-a617-363d9b618d23 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:56.055694 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e4989af2-dafb-494e-a617-363d9b618d23 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:56.061895 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e4989af2-dafb-494e-a617-363d9b618d23 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:56.062349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e4989af2-dafb-494e-a617-363d9b618d23 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:56.063145 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e4989af2-dafb-494e-a617-363d9b618d23 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:56.063582 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e4989af2-dafb-494e-a617-363d9b618d23 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:56.201431 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e4989af2-dafb-494e-a617-363d9b618d23 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:56.209317 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e4989af2-dafb-494e-a617-363d9b618d23 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1678 microversion: 2.1 time: 0.158493 May 19 12:23:56.210207 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 298/649] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:56 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:56.344869 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-51440b03-3c02-4a99-8c77-385526f2b9fa tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:56.345559 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-51440b03-3c02-4a99-8c77-385526f2b9fa tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:56.352844 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-51440b03-3c02-4a99-8c77-385526f2b9fa tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:56.353297 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-51440b03-3c02-4a99-8c77-385526f2b9fa tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:56.354052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-51440b03-3c02-4a99-8c77-385526f2b9fa tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:56.354515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-51440b03-3c02-4a99-8c77-385526f2b9fa tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:56.492345 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-51440b03-3c02-4a99-8c77-385526f2b9fa tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:56.500859 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-51440b03-3c02-4a99-8c77-385526f2b9fa tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:56.502535 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-51440b03-3c02-4a99-8c77-385526f2b9fa tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:56.503694 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-51440b03-3c02-4a99-8c77-385526f2b9fa tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.163251 May 19 12:23:56.504291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 352/650] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:56 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:57.227564 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-1853657c-e85d-4d1c-93d4-6a7db67a3f84 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:57.228146 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-1853657c-e85d-4d1c-93d4-6a7db67a3f84 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:57.234937 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1853657c-e85d-4d1c-93d4-6a7db67a3f84 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:57.235385 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1853657c-e85d-4d1c-93d4-6a7db67a3f84 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:57.236186 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1853657c-e85d-4d1c-93d4-6a7db67a3f84 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:57.236623 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1853657c-e85d-4d1c-93d4-6a7db67a3f84 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:57.372135 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-1853657c-e85d-4d1c-93d4-6a7db67a3f84 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:57.379728 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-1853657c-e85d-4d1c-93d4-6a7db67a3f84 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1678 microversion: 2.1 time: 0.156240 May 19 12:23:57.380333 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 299/651] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:57 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:23:57.522996 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-607aae32-c772-476d-9101-774700f2e17e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:57.523541 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-607aae32-c772-476d-9101-774700f2e17e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:57.531181 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-607aae32-c772-476d-9101-774700f2e17e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:57.531632 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-607aae32-c772-476d-9101-774700f2e17e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:57.532463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-607aae32-c772-476d-9101-774700f2e17e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:57.532897 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-607aae32-c772-476d-9101-774700f2e17e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:57.664501 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-607aae32-c772-476d-9101-774700f2e17e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:57.673068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-607aae32-c772-476d-9101-774700f2e17e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:57.674554 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-607aae32-c772-476d-9101-774700f2e17e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:57.675704 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-607aae32-c772-476d-9101-774700f2e17e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.157166 May 19 12:23:57.676295 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 353/652] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:57 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:58.398355 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-3efb32a1-ed53-4344-a009-16c835a87235 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:58.398977 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-3efb32a1-ed53-4344-a009-16c835a87235 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:58.406078 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3efb32a1-ed53-4344-a009-16c835a87235 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:58.406514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3efb32a1-ed53-4344-a009-16c835a87235 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:58.407286 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3efb32a1-ed53-4344-a009-16c835a87235 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:58.408009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3efb32a1-ed53-4344-a009-16c835a87235 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:58.538778 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-3efb32a1-ed53-4344-a009-16c835a87235 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:58.546496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-3efb32a1-ed53-4344-a009-16c835a87235 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1678 microversion: 2.1 time: 0.152553 May 19 12:23:58.547073 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 300/653] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:58 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:58.695858 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4935807a-f86e-472a-9905-978369f8c2a2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:58.696401 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4935807a-f86e-472a-9905-978369f8c2a2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:58.702912 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4935807a-f86e-472a-9905-978369f8c2a2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:58.703368 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4935807a-f86e-472a-9905-978369f8c2a2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:58.704144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4935807a-f86e-472a-9905-978369f8c2a2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:58.704573 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4935807a-f86e-472a-9905-978369f8c2a2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:58.860027 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4935807a-f86e-472a-9905-978369f8c2a2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:58.870453 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4935807a-f86e-472a-9905-978369f8c2a2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:58.872078 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4935807a-f86e-472a-9905-978369f8c2a2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:58.873396 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4935807a-f86e-472a-9905-978369f8c2a2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.182147 May 19 12:23:58.874000 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 354/654] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:58 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:59.564434 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-241c926a-211e-4059-8507-01bac92ccd1a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:59.565063 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-241c926a-211e-4059-8507-01bac92ccd1a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:59.572102 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-241c926a-211e-4059-8507-01bac92ccd1a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:59.572558 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-241c926a-211e-4059-8507-01bac92ccd1a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:59.573355 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-241c926a-211e-4059-8507-01bac92ccd1a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:59.573796 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-241c926a-211e-4059-8507-01bac92ccd1a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:59.706133 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-241c926a-211e-4059-8507-01bac92ccd1a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:23:59.714439 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-241c926a-211e-4059-8507-01bac92ccd1a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1678 microversion: 2.1 time: 0.153967 May 19 12:23:59.715019 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 301/655] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:23:59 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:23:59.893700 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f7023299-8fce-4b6c-87e2-89d718c66949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:23:59.894294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f7023299-8fce-4b6c-87e2-89d718c66949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:23:59.901645 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f7023299-8fce-4b6c-87e2-89d718c66949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:59.902093 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f7023299-8fce-4b6c-87e2-89d718c66949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:59.902863 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f7023299-8fce-4b6c-87e2-89d718c66949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:59.903304 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f7023299-8fce-4b6c-87e2-89d718c66949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:00.040181 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f7023299-8fce-4b6c-87e2-89d718c66949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:00.043740 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:00.049098 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f7023299-8fce-4b6c-87e2-89d718c66949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:00.050595 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f7023299-8fce-4b6c-87e2-89d718c66949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:00.051750 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f7023299-8fce-4b6c-87e2-89d718c66949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.162303 May 19 12:24:00.052325 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 355/656] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:23:59 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:24:00.731899 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-91e4e4d3-7f47-48a6-bd1f-b0ce15de357a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:00.732503 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-91e4e4d3-7f47-48a6-bd1f-b0ce15de357a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:00.739237 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-91e4e4d3-7f47-48a6-bd1f-b0ce15de357a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:00.739685 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-91e4e4d3-7f47-48a6-bd1f-b0ce15de357a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:00.741480 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-91e4e4d3-7f47-48a6-bd1f-b0ce15de357a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:00.742112 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-91e4e4d3-7f47-48a6-bd1f-b0ce15de357a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:00.871606 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-91e4e4d3-7f47-48a6-bd1f-b0ce15de357a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:00.879071 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-91e4e4d3-7f47-48a6-bd1f-b0ce15de357a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1678 microversion: 2.1 time: 0.151165 May 19 12:24:00.879629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 302/657] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:00 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:01.071264 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b38736b0-afa2-4f4e-aef6-2d15826021a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:01.071934 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b38736b0-afa2-4f4e-aef6-2d15826021a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:01.078878 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b38736b0-afa2-4f4e-aef6-2d15826021a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:01.079323 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b38736b0-afa2-4f4e-aef6-2d15826021a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:01.080109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b38736b0-afa2-4f4e-aef6-2d15826021a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:01.080544 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b38736b0-afa2-4f4e-aef6-2d15826021a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:01.219362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b38736b0-afa2-4f4e-aef6-2d15826021a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:01.228404 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b38736b0-afa2-4f4e-aef6-2d15826021a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:01.229893 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b38736b0-afa2-4f4e-aef6-2d15826021a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:01.231039 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b38736b0-afa2-4f4e-aef6-2d15826021a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.164046 May 19 12:24:01.231588 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 356/658] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:24:01 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:24:01.896644 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a06a7f31-ea30-43db-9e73-f59e46a65f6b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:01.897696 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a06a7f31-ea30-43db-9e73-f59e46a65f6b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:01.903797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a06a7f31-ea30-43db-9e73-f59e46a65f6b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:01.904264 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a06a7f31-ea30-43db-9e73-f59e46a65f6b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:01.910054 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a06a7f31-ea30-43db-9e73-f59e46a65f6b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:01.910054 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a06a7f31-ea30-43db-9e73-f59e46a65f6b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:02.037469 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a06a7f31-ea30-43db-9e73-f59e46a65f6b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:02.045231 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a06a7f31-ea30-43db-9e73-f59e46a65f6b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1678 microversion: 2.1 time: 0.153032 May 19 12:24:02.045801 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 303/659] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:01 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:02.249764 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a05c57e0-c5bf-42ba-9cdf-8e81d15f7aa7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:02.250286 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a05c57e0-c5bf-42ba-9cdf-8e81d15f7aa7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:02.258657 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a05c57e0-c5bf-42ba-9cdf-8e81d15f7aa7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:02.259111 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a05c57e0-c5bf-42ba-9cdf-8e81d15f7aa7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:02.259922 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a05c57e0-c5bf-42ba-9cdf-8e81d15f7aa7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:02.260395 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a05c57e0-c5bf-42ba-9cdf-8e81d15f7aa7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:02.394597 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a05c57e0-c5bf-42ba-9cdf-8e81d15f7aa7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:02.404807 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a05c57e0-c5bf-42ba-9cdf-8e81d15f7aa7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:02.406420 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a05c57e0-c5bf-42ba-9cdf-8e81d15f7aa7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:02.407674 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a05c57e0-c5bf-42ba-9cdf-8e81d15f7aa7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.161895 May 19 12:24:02.408276 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 357/660] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:24:02 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:24:03.062785 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b3e5b92b-d2ce-4961-893a-f12748047089 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:03.063398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-b3e5b92b-d2ce-4961-893a-f12748047089 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:03.070660 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b3e5b92b-d2ce-4961-893a-f12748047089 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:03.071106 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b3e5b92b-d2ce-4961-893a-f12748047089 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:03.071898 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b3e5b92b-d2ce-4961-893a-f12748047089 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:03.072330 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b3e5b92b-d2ce-4961-893a-f12748047089 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:03.213345 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b3e5b92b-d2ce-4961-893a-f12748047089 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:03.221341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b3e5b92b-d2ce-4961-893a-f12748047089 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1678 microversion: 2.1 time: 0.162562 May 19 12:24:03.221913 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 304/661] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:03 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:03.426613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2e415762-9b71-4394-abfa-b583d197fe57 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:03.427760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2e415762-9b71-4394-abfa-b583d197fe57 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:03.434611 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2e415762-9b71-4394-abfa-b583d197fe57 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:03.435067 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2e415762-9b71-4394-abfa-b583d197fe57 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:03.435874 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2e415762-9b71-4394-abfa-b583d197fe57 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:03.436304 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2e415762-9b71-4394-abfa-b583d197fe57 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:03.572351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2e415762-9b71-4394-abfa-b583d197fe57 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:03.580999 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2e415762-9b71-4394-abfa-b583d197fe57 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:03.582494 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2e415762-9b71-4394-abfa-b583d197fe57 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:03.583824 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2e415762-9b71-4394-abfa-b583d197fe57 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.161155 May 19 12:24:03.584395 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 358/662] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:24:03 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:24:03.903316 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-1b0aec15-7bc0-4a1b-b25e-643aee4500ef req-fd7bf955-c91d-42d2-b734-6767eb5df750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aedab7fb-ae90-48e1-8745-626d60c88a1a", "name": "network-vif-plugged", "status": "completed", "tag": "5fc43837-dd78-4f9a-ab74-cfe109a4819d"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:03.911480 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-1b0aec15-7bc0-4a1b-b25e-643aee4500ef req-fd7bf955-c91d-42d2-b734-6767eb5df750 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:03.912486 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-1b0aec15-7bc0-4a1b-b25e-643aee4500ef req-fd7bf955-c91d-42d2-b734-6767eb5df750 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:03.923216 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-1b0aec15-7bc0-4a1b-b25e-643aee4500ef req-fd7bf955-c91d-42d2-b734-6767eb5df750 service nova] Creating event network-vif-plugged:5fc43837-dd78-4f9a-ab74-cfe109a4819d for instance aedab7fb-ae90-48e1-8745-626d60c88a1a on hv-cinder-80475 May 19 12:24:03.930507 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-1b0aec15-7bc0-4a1b-b25e-643aee4500ef req-fd7bf955-c91d-42d2-b734-6767eb5df750 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087752 May 19 12:24:03.931440 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 305/663] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:04.239861 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7a0eda94-8452-45b8-8881-a274a5adca81 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:04.240955 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7a0eda94-8452-45b8-8881-a274a5adca81 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:04.247898 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7a0eda94-8452-45b8-8881-a274a5adca81 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:04.248350 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7a0eda94-8452-45b8-8881-a274a5adca81 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:04.249116 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7a0eda94-8452-45b8-8881-a274a5adca81 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:04.249553 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7a0eda94-8452-45b8-8881-a274a5adca81 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:04.388674 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7a0eda94-8452-45b8-8881-a274a5adca81 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:04.398063 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7a0eda94-8452-45b8-8881-a274a5adca81 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1678 microversion: 2.1 time: 0.162108 May 19 12:24:04.398645 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 359/664] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:04 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:04.603352 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e1634708-e022-4659-a48b-db1640332fdf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:04.604070 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e1634708-e022-4659-a48b-db1640332fdf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:04.610680 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e1634708-e022-4659-a48b-db1640332fdf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:04.611135 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e1634708-e022-4659-a48b-db1640332fdf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:04.611919 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e1634708-e022-4659-a48b-db1640332fdf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:04.612352 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e1634708-e022-4659-a48b-db1640332fdf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:04.746125 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e1634708-e022-4659-a48b-db1640332fdf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:04.754726 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e1634708-e022-4659-a48b-db1640332fdf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:04.759151 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e1634708-e022-4659-a48b-db1640332fdf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:04.760395 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e1634708-e022-4659-a48b-db1640332fdf tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.162217 May 19 12:24:04.760966 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 306/665] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:24:04 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:24:05.416599 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-df0fd0ac-498d-4e17-93d8-b52daf6b6e32 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:05.417190 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-df0fd0ac-498d-4e17-93d8-b52daf6b6e32 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:05.424324 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df0fd0ac-498d-4e17-93d8-b52daf6b6e32 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:05.424770 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df0fd0ac-498d-4e17-93d8-b52daf6b6e32 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:05.425525 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df0fd0ac-498d-4e17-93d8-b52daf6b6e32 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:05.425960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df0fd0ac-498d-4e17-93d8-b52daf6b6e32 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:05.562132 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-df0fd0ac-498d-4e17-93d8-b52daf6b6e32 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:05.570560 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-df0fd0ac-498d-4e17-93d8-b52daf6b6e32 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1678 microversion: 2.1 time: 0.158834 May 19 12:24:05.571141 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 360/666] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:05 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:05.779939 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-104eb922-28c8-4bbe-8628-6051b48aaa35 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:05.780582 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-104eb922-28c8-4bbe-8628-6051b48aaa35 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:05.788064 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-104eb922-28c8-4bbe-8628-6051b48aaa35 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:05.788699 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-104eb922-28c8-4bbe-8628-6051b48aaa35 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:05.789699 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-104eb922-28c8-4bbe-8628-6051b48aaa35 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:05.790193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-104eb922-28c8-4bbe-8628-6051b48aaa35 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:05.922339 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-104eb922-28c8-4bbe-8628-6051b48aaa35 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:05.931150 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-104eb922-28c8-4bbe-8628-6051b48aaa35 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:05.932682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-104eb922-28c8-4bbe-8628-6051b48aaa35 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:05.933837 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-104eb922-28c8-4bbe-8628-6051b48aaa35 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.157864 May 19 12:24:05.934389 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 307/667] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:24:05 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:24:06.588939 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-15ea3e59-4fcb-4684-b4b3-d8beb53cb874 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:06.589560 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-15ea3e59-4fcb-4684-b4b3-d8beb53cb874 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:06.595631 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-15ea3e59-4fcb-4684-b4b3-d8beb53cb874 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:06.596123 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-15ea3e59-4fcb-4684-b4b3-d8beb53cb874 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:06.596893 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-15ea3e59-4fcb-4684-b4b3-d8beb53cb874 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:06.597333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-15ea3e59-4fcb-4684-b4b3-d8beb53cb874 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:06.734747 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-15ea3e59-4fcb-4684-b4b3-d8beb53cb874 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:06.743338 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-15ea3e59-4fcb-4684-b4b3-d8beb53cb874 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1678 microversion: 2.1 time: 0.158736 May 19 12:24:06.743994 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 361/668] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:06 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:06.954359 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-36053408-5fa2-4263-8b90-38bfd5d3139b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:06.954359 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-36053408-5fa2-4263-8b90-38bfd5d3139b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:06.959819 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-36053408-5fa2-4263-8b90-38bfd5d3139b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:06.960366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-36053408-5fa2-4263-8b90-38bfd5d3139b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:06.961023 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-36053408-5fa2-4263-8b90-38bfd5d3139b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:06.961457 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-36053408-5fa2-4263-8b90-38bfd5d3139b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:07.108213 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-36053408-5fa2-4263-8b90-38bfd5d3139b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:07.117678 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-36053408-5fa2-4263-8b90-38bfd5d3139b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:07.119186 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-36053408-5fa2-4263-8b90-38bfd5d3139b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:07.120421 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-36053408-5fa2-4263-8b90-38bfd5d3139b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.172671 May 19 12:24:07.131546 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 308/669] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:24:06 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:24:07.761318 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c310ce57-4305-4a3f-a8d8-cb1838fc4b24 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:07.761869 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c310ce57-4305-4a3f-a8d8-cb1838fc4b24 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:07.768608 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c310ce57-4305-4a3f-a8d8-cb1838fc4b24 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:07.769068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c310ce57-4305-4a3f-a8d8-cb1838fc4b24 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:07.769854 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c310ce57-4305-4a3f-a8d8-cb1838fc4b24 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:07.770292 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c310ce57-4305-4a3f-a8d8-cb1838fc4b24 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:07.901905 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c310ce57-4305-4a3f-a8d8-cb1838fc4b24 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:07.909484 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c310ce57-4305-4a3f-a8d8-cb1838fc4b24 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1678 microversion: 2.1 time: 0.152217 May 19 12:24:07.910058 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 362/670] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:07 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:08.138548 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6e5d5996-03bc-4582-9888-3ba84407bc8b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:08.139168 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6e5d5996-03bc-4582-9888-3ba84407bc8b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:08.146312 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6e5d5996-03bc-4582-9888-3ba84407bc8b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:08.146976 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6e5d5996-03bc-4582-9888-3ba84407bc8b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:08.147813 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6e5d5996-03bc-4582-9888-3ba84407bc8b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:08.148245 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6e5d5996-03bc-4582-9888-3ba84407bc8b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:08.285685 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6e5d5996-03bc-4582-9888-3ba84407bc8b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:08.295079 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6e5d5996-03bc-4582-9888-3ba84407bc8b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:08.296628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6e5d5996-03bc-4582-9888-3ba84407bc8b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:08.297794 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6e5d5996-03bc-4582-9888-3ba84407bc8b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1807 microversion: 2.20 time: 0.163203 May 19 12:24:08.298355 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 309/671] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:24:08 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:24:08.927384 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3c8fe3e8-cdb1-424c-bcb9-9e5d479cbab1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:08.928024 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3c8fe3e8-cdb1-424c-bcb9-9e5d479cbab1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:08.934738 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3c8fe3e8-cdb1-424c-bcb9-9e5d479cbab1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:08.935187 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3c8fe3e8-cdb1-424c-bcb9-9e5d479cbab1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:08.936049 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3c8fe3e8-cdb1-424c-bcb9-9e5d479cbab1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:08.936484 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3c8fe3e8-cdb1-424c-bcb9-9e5d479cbab1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:09.075746 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3c8fe3e8-cdb1-424c-bcb9-9e5d479cbab1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:09.084261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3c8fe3e8-cdb1-424c-bcb9-9e5d479cbab1 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1678 microversion: 2.1 time: 0.160101 May 19 12:24:09.084872 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 363/672] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:08 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:09.316104 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-26b35cd2-f3f4-4c65-b128-efd75b76b1a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:09.316743 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-26b35cd2-f3f4-4c65-b128-efd75b76b1a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:09.319946 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=42 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:09.325059 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-26b35cd2-f3f4-4c65-b128-efd75b76b1a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:09.325510 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-26b35cd2-f3f4-4c65-b128-efd75b76b1a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:09.326285 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-26b35cd2-f3f4-4c65-b128-efd75b76b1a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:09.326723 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-26b35cd2-f3f4-4c65-b128-efd75b76b1a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:09.464513 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-26b35cd2-f3f4-4c65-b128-efd75b76b1a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:09.473758 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-26b35cd2-f3f4-4c65-b128-efd75b76b1a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:09.475361 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-26b35cd2-f3f4-4c65-b128-efd75b76b1a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:09.476610 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-26b35cd2-f3f4-4c65-b128-efd75b76b1a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1794 microversion: 2.20 time: 0.164547 May 19 12:24:09.477383 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 310/673] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:24:09 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1794 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:24:10.102067 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8dc4a2aa-20a2-406f-8bcb-b6b4e31b3a1f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:10.102691 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8dc4a2aa-20a2-406f-8bcb-b6b4e31b3a1f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:10.109679 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8dc4a2aa-20a2-406f-8bcb-b6b4e31b3a1f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:10.110123 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8dc4a2aa-20a2-406f-8bcb-b6b4e31b3a1f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:10.110876 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8dc4a2aa-20a2-406f-8bcb-b6b4e31b3a1f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:10.111305 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8dc4a2aa-20a2-406f-8bcb-b6b4e31b3a1f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:10.248901 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8dc4a2aa-20a2-406f-8bcb-b6b4e31b3a1f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:10.257181 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8dc4a2aa-20a2-406f-8bcb-b6b4e31b3a1f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1678 microversion: 2.1 time: 0.158973 May 19 12:24:10.257754 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 364/674] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:10 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:11.276797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e43febdc-10d4-4854-88e4-f99b3054ab66 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:11.277400 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e43febdc-10d4-4854-88e4-f99b3054ab66 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:11.284291 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e43febdc-10d4-4854-88e4-f99b3054ab66 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:11.284746 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e43febdc-10d4-4854-88e4-f99b3054ab66 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:11.285683 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e43febdc-10d4-4854-88e4-f99b3054ab66 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:11.286171 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e43febdc-10d4-4854-88e4-f99b3054ab66 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:11.421967 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e43febdc-10d4-4854-88e4-f99b3054ab66 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:11.429861 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e43febdc-10d4-4854-88e4-f99b3054ab66 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1678 microversion: 2.1 time: 0.158147 May 19 12:24:11.430421 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 311/675] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:11 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:12.447358 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-330a6c6c-4f3c-4de5-90c0-a6671c8cedd2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:12.448025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-330a6c6c-4f3c-4de5-90c0-a6671c8cedd2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:12.454599 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-330a6c6c-4f3c-4de5-90c0-a6671c8cedd2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:12.455046 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-330a6c6c-4f3c-4de5-90c0-a6671c8cedd2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:12.455825 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-330a6c6c-4f3c-4de5-90c0-a6671c8cedd2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:12.456288 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-330a6c6c-4f3c-4de5-90c0-a6671c8cedd2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:12.589996 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-330a6c6c-4f3c-4de5-90c0-a6671c8cedd2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:12.598449 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-330a6c6c-4f3c-4de5-90c0-a6671c8cedd2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1655 microversion: 2.1 time: 0.155452 May 19 12:24:12.599777 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 365/676] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:12 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:12.618910 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-1805272e-c412-40d2-999d-8573c6218015 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:12.625350 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1805272e-c412-40d2-999d-8573c6218015 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:12.625923 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1805272e-c412-40d2-999d-8573c6218015 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:12.681521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=100 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:12.687409 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-1805272e-c412-40d2-999d-8573c6218015 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Going to try to start instance {{(pid=117964) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 12:24:12.916248 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-1805272e-c412-40d2-999d-8573c6218015 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "POST /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0/action" status: 202 len: 0 microversion: 2.1 time: 0.302941 May 19 12:24:12.916883 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 312/677] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 19 12:24:12 2022] POST /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:24:12.925091 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-50819c7d-4646-4019-a741-b41f678cb112 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:12.925728 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-50819c7d-4646-4019-a741-b41f678cb112 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:12.936862 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-50819c7d-4646-4019-a741-b41f678cb112 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:12.936862 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-50819c7d-4646-4019-a741-b41f678cb112 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:12.936862 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-50819c7d-4646-4019-a741-b41f678cb112 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:12.936862 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-50819c7d-4646-4019-a741-b41f678cb112 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:13.065857 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-50819c7d-4646-4019-a741-b41f678cb112 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:13.074809 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-50819c7d-4646-4019-a741-b41f678cb112 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1664 microversion: 2.1 time: 0.153517 May 19 12:24:13.075411 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 366/678] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:12 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:14.093855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-fa1fe2d9-fe46-495d-a439-1331ff664354 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:14.094547 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-fa1fe2d9-fe46-495d-a439-1331ff664354 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:14.101362 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa1fe2d9-fe46-495d-a439-1331ff664354 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:14.101807 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa1fe2d9-fe46-495d-a439-1331ff664354 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:14.102562 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa1fe2d9-fe46-495d-a439-1331ff664354 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:14.102995 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa1fe2d9-fe46-495d-a439-1331ff664354 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:14.237843 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-fa1fe2d9-fe46-495d-a439-1331ff664354 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:14.245391 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-fa1fe2d9-fe46-495d-a439-1331ff664354 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1664 microversion: 2.1 time: 0.156211 May 19 12:24:14.245967 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 313/679] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:14 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:15.262563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-09c64fa1-03ac-466d-bd37-a4d2f8a68fd7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:15.263121 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-09c64fa1-03ac-466d-bd37-a4d2f8a68fd7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:15.265526 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=44 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:15.270279 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-09c64fa1-03ac-466d-bd37-a4d2f8a68fd7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:15.270950 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-09c64fa1-03ac-466d-bd37-a4d2f8a68fd7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:15.271730 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-09c64fa1-03ac-466d-bd37-a4d2f8a68fd7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:15.272226 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-09c64fa1-03ac-466d-bd37-a4d2f8a68fd7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:15.403832 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-09c64fa1-03ac-466d-bd37-a4d2f8a68fd7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:15.411500 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-09c64fa1-03ac-466d-bd37-a4d2f8a68fd7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1668 microversion: 2.1 time: 0.152791 May 19 12:24:15.412102 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 367/680] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:15 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:31.729154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5ac4528f-bf9e-4068-930c-0f4db31e205a tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:31.730202 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5ac4528f-bf9e-4068-930c-0f4db31e205a tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:31.733094 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=7 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:31.733760 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:31.739337 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5ac4528f-bf9e-4068-930c-0f4db31e205a tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:31.739815 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5ac4528f-bf9e-4068-930c-0f4db31e205a tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:31.740626 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5ac4528f-bf9e-4068-930c-0f4db31e205a tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:31.741064 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5ac4528f-bf9e-4068-930c-0f4db31e205a tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:32.145696 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5ac4528f-bf9e-4068-930c-0f4db31e205a tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "POST /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/action" status: 202 len: 0 microversion: 2.1 time: 0.421256 May 19 12:24:32.146338 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 314/681] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 19 12:24:31 2022] POST /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:24:32.161753 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b12a3261-7eb4-4dfe-a81e-d2bff074fa60 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:32.162393 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b12a3261-7eb4-4dfe-a81e-d2bff074fa60 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:32.165314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:32.165970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=72 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:32.170828 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b12a3261-7eb4-4dfe-a81e-d2bff074fa60 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:32.171276 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b12a3261-7eb4-4dfe-a81e-d2bff074fa60 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:32.172090 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b12a3261-7eb4-4dfe-a81e-d2bff074fa60 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:32.172543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b12a3261-7eb4-4dfe-a81e-d2bff074fa60 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:32.319305 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b12a3261-7eb4-4dfe-a81e-d2bff074fa60 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:32.327291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b12a3261-7eb4-4dfe-a81e-d2bff074fa60 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1751 microversion: 2.1 time: 0.170111 May 19 12:24:32.327885 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 368/682] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:32 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:33.346531 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-3c02316b-f69c-4673-b984-d77ca8f0405b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:33.347232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-3c02316b-f69c-4673-b984-d77ca8f0405b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:33.354434 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3c02316b-f69c-4673-b984-d77ca8f0405b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:33.354880 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3c02316b-f69c-4673-b984-d77ca8f0405b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:33.355647 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3c02316b-f69c-4673-b984-d77ca8f0405b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:33.356115 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3c02316b-f69c-4673-b984-d77ca8f0405b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:33.501473 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-3c02316b-f69c-4673-b984-d77ca8f0405b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:33.510262 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-3c02316b-f69c-4673-b984-d77ca8f0405b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1756 microversion: 2.1 time: 0.168751 May 19 12:24:33.510831 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 315/683] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:33 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:34.528866 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-009ab19c-84c9-46fe-9dcd-8eeff990139d tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:34.529453 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-009ab19c-84c9-46fe-9dcd-8eeff990139d tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:34.536667 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-009ab19c-84c9-46fe-9dcd-8eeff990139d tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:34.537107 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-009ab19c-84c9-46fe-9dcd-8eeff990139d tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:34.537930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-009ab19c-84c9-46fe-9dcd-8eeff990139d tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:34.538466 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-009ab19c-84c9-46fe-9dcd-8eeff990139d tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:34.685093 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-009ab19c-84c9-46fe-9dcd-8eeff990139d tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:34.693623 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-009ab19c-84c9-46fe-9dcd-8eeff990139d tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1756 microversion: 2.1 time: 0.168938 May 19 12:24:34.694189 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 369/684] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:34 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:35.187377 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9d80f6d1-5423-4a3a-ae1e-a3266659ec1a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:35.187936 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9d80f6d1-5423-4a3a-ae1e-a3266659ec1a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:35.194061 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9d80f6d1-5423-4a3a-ae1e-a3266659ec1a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:35.194507 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9d80f6d1-5423-4a3a-ae1e-a3266659ec1a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:35.195269 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9d80f6d1-5423-4a3a-ae1e-a3266659ec1a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:35.195698 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9d80f6d1-5423-4a3a-ae1e-a3266659ec1a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:35.218715 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9d80f6d1-5423-4a3a-ae1e-a3266659ec1a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04/ips" status: 200 len: 149 microversion: 2.1 time: 0.088767 May 19 12:24:35.219187 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 316/685] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 19 12:24:35 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04/ips => generated 149 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:35.230392 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ec17ea54-5bbf-4471-b2a6-c7bba83563da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df9d793b-c31e-4feb-9ebb-651e35ef8881"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:35.231508 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ec17ea54-5bbf-4471-b2a6-c7bba83563da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:35.237810 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ec17ea54-5bbf-4471-b2a6-c7bba83563da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:35.238314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ec17ea54-5bbf-4471-b2a6-c7bba83563da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:35.239853 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ec17ea54-5bbf-4471-b2a6-c7bba83563da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:35.240291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ec17ea54-5bbf-4471-b2a6-c7bba83563da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:35.321359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-ec17ea54-5bbf-4471-b2a6-c7bba83563da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] HTTP exception thrown: Invalid volume: volume df9d793b-c31e-4feb-9ebb-651e35ef8881 is already attached to instances: 51363d7f-7d31-427b-87c1-fa437e713d85 May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ec17ea54-5bbf-4471-b2a6-c7bba83563da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Request method failure captured: May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: POST /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04/os-volume_attachments HTTP/1.1 May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 74 May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjWEBNF2DeurAd4vIS9t5sXixknAa9oMvXKGIT7BVlMgRbph3mSe132nYVois5KyltYyb0JHe3nInO6bVt7M3Z2oZ1xRzJyjOamBOcNMxIEvcJ1cyR56gBj_EXYQnPZDcjZT6Ja0FtOHx4Rd4HuWodV9rlQ_CBw1MTfirEySyppbNDw May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:24:35.323068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:24:35.324779 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2de86d602945238f5df0e2c388004f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:24:35.324779 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeNegativeTest-50904330 May 19 12:24:35.324779 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:24:35.324779 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:24:35.324779 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:24:35.324779 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:24:35.324779 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:24:35.324779 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: dd39ddcf4ab045b98a737ee529a2dcce May 19 12:24:35.324779 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:24:35.324779 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: May 19 12:24:35.324779 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {"volumeAttachment": {"volumeId": "df9d793b-c31e-4feb-9ebb-651e35ef8881"}} May 19 12:24:35.324779 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:24:35.325709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Invalid volume: volume df9d793b-c31e-4feb-9ebb-651e35ef8881 is already attached to instances: 51363d7f-7d31-427b-87c1-fa437e713d85 May 19 12:24:35.325709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'server_id': '8cac13b6-2524-4f4b-879d-0e6723932d04', 'body': {'volumeAttachment': {'volumeId': 'df9d793b-c31e-4feb-9ebb-651e35ef8881'}}} May 19 12:24:35.325709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:24:35.325709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:24:35.325709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 12:24:35.325709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 12:24:35.325709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 12:24:35.325709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 12:24:35.325709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 12:24:35.325709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 12:24:35.325709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 12:24:35.325709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 12:24:35.325709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 12:24:35.325709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 12:24:35.325709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume df9d793b-c31e-4feb-9ebb-651e35ef8881 is already attached to instances: 51363d7f-7d31-427b-87c1-fa437e713d85 May 19 12:24:35.325709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:24:35.325709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:24:35.325709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:24:35.325709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume df9d793b-c31e-4feb-9ebb-651e35ef8881 is already attached to instances: 51363d7f-7d31-427b-87c1-fa437e713d85 May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:24:35.327185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:24:35.328854 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:24:35.328854 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:24:35.328854 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:24:35.328854 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume df9d793b-c31e-4feb-9ebb-651e35ef8881 is already attached to instances: 51363d7f-7d31-427b-87c1-fa437e713d85 May 19 12:24:35.328854 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:24:35.328854 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ec17ea54-5bbf-4471-b2a6-c7bba83563da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Returning 400 to user: Invalid volume: volume df9d793b-c31e-4feb-9ebb-651e35ef8881 is already attached to instances: 51363d7f-7d31-427b-87c1-fa437e713d85 {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:24:35.328854 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ec17ea54-5bbf-4471-b2a6-c7bba83563da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "POST /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098172 May 19 12:24:35.328854 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 370/686] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 19 12:24:35 2022] POST /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 12:24:35.334142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d639cd1d-1dda-46f6-8d7d-eb4f5c4f1e88 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:35.334631 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d639cd1d-1dda-46f6-8d7d-eb4f5c4f1e88 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:35.340642 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d639cd1d-1dda-46f6-8d7d-eb4f5c4f1e88 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:35.341090 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d639cd1d-1dda-46f6-8d7d-eb4f5c4f1e88 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:35.341850 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d639cd1d-1dda-46f6-8d7d-eb4f5c4f1e88 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:35.342283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d639cd1d-1dda-46f6-8d7d-eb4f5c4f1e88 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:35.366433 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d639cd1d-1dda-46f6-8d7d-eb4f5c4f1e88 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Going to try to terminate instance {{(pid=117964) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:24:35.710402 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-973533c0-fb19-4de7-a180-c45e12d70204 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:35.711024 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-973533c0-fb19-4de7-a180-c45e12d70204 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:35.718207 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-973533c0-fb19-4de7-a180-c45e12d70204 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:35.727122 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-973533c0-fb19-4de7-a180-c45e12d70204 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:35.727122 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-973533c0-fb19-4de7-a180-c45e12d70204 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:35.727122 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-973533c0-fb19-4de7-a180-c45e12d70204 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:35.752640 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d639cd1d-1dda-46f6-8d7d-eb4f5c4f1e88 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 204 len: 0 microversion: 2.1 time: 0.422746 May 19 12:24:35.753233 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 317/687] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:24:35 2022] DELETE /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:24:35.760519 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9da8da2e-6d2e-456b-be9d-87099940532e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:35.761713 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9da8da2e-6d2e-456b-be9d-87099940532e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:35.769281 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9da8da2e-6d2e-456b-be9d-87099940532e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:35.769762 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9da8da2e-6d2e-456b-be9d-87099940532e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:35.770854 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9da8da2e-6d2e-456b-be9d-87099940532e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:35.771343 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9da8da2e-6d2e-456b-be9d-87099940532e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:35.859178 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.objects.instance [None req-9da8da2e-6d2e-456b-be9d-87099940532e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lazy-loading 'services' on Instance uuid caffcacb-8fb4-412e-ae78-67570b491068 {{(pid=117964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:24:35.872588 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-973533c0-fb19-4de7-a180-c45e12d70204 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:35.887994 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-973533c0-fb19-4de7-a180-c45e12d70204 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1756 microversion: 2.1 time: 0.174284 May 19 12:24:35.887994 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 371/688] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:35 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:35.887994 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bf41db83-647a-4cbf-b40c-c538e450ccab tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:35.887994 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bf41db83-647a-4cbf-b40c-c538e450ccab tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:35.894735 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bf41db83-647a-4cbf-b40c-c538e450ccab tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:35.895321 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bf41db83-647a-4cbf-b40c-c538e450ccab tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:35.896185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bf41db83-647a-4cbf-b40c-c538e450ccab tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:35.896629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bf41db83-647a-4cbf-b40c-c538e450ccab tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:36.028762 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bf41db83-647a-4cbf-b40c-c538e450ccab tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:36.037318 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bf41db83-647a-4cbf-b40c-c538e450ccab tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1681 microversion: 2.1 time: 0.154749 May 19 12:24:36.037901 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 372/689] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:35 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:36.139874 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9da8da2e-6d2e-456b-be9d-87099940532e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "DELETE /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/os-volume_attachments/36d4bb2b-45df-464c-a72c-84491cd36bbe" status: 202 len: 0 microversion: 2.1 time: 0.385168 May 19 12:24:36.140400 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 318/690] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 19 12:24:35 2022] DELETE /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/os-volume_attachments/36d4bb2b-45df-464c-a72c-84491cd36bbe => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:24:36.148629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b13021f1-408e-4d6b-8b3d-b5f3fcae3e68 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:36.149656 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b13021f1-408e-4d6b-8b3d-b5f3fcae3e68 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:36.155770 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b13021f1-408e-4d6b-8b3d-b5f3fcae3e68 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:36.156754 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b13021f1-408e-4d6b-8b3d-b5f3fcae3e68 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:36.157041 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b13021f1-408e-4d6b-8b3d-b5f3fcae3e68 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:36.157475 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b13021f1-408e-4d6b-8b3d-b5f3fcae3e68 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:36.188963 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b13021f1-408e-4d6b-8b3d-b5f3fcae3e68 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044205 May 19 12:24:36.189520 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 373/691] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:24:36 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:36.899706 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-696acec7-1976-4ad9-879f-72d60febc2e0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:36.900473 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-696acec7-1976-4ad9-879f-72d60febc2e0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:36.907273 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-696acec7-1976-4ad9-879f-72d60febc2e0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:36.907725 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-696acec7-1976-4ad9-879f-72d60febc2e0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:36.908518 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-696acec7-1976-4ad9-879f-72d60febc2e0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:36.908976 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-696acec7-1976-4ad9-879f-72d60febc2e0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:37.055204 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9d89e41c-cfd6-4854-81ec-56960ddeaca8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:37.055867 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9d89e41c-cfd6-4854-81ec-56960ddeaca8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:37.056103 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-696acec7-1976-4ad9-879f-72d60febc2e0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:37.062749 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9d89e41c-cfd6-4854-81ec-56960ddeaca8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:37.063200 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9d89e41c-cfd6-4854-81ec-56960ddeaca8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:37.064006 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9d89e41c-cfd6-4854-81ec-56960ddeaca8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:37.064936 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9d89e41c-cfd6-4854-81ec-56960ddeaca8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:37.072781 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-696acec7-1976-4ad9-879f-72d60febc2e0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1756 microversion: 2.1 time: 0.169673 May 19 12:24:37.072781 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 319/692] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:36 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:37.200300 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9d89e41c-cfd6-4854-81ec-56960ddeaca8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:37.201220 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c58dadb5-4e0c-47b0-a6e6-3231cc281b11 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:37.202251 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c58dadb5-4e0c-47b0-a6e6-3231cc281b11 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:37.208349 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9d89e41c-cfd6-4854-81ec-56960ddeaca8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1681 microversion: 2.1 time: 0.157627 May 19 12:24:37.208927 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 374/693] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:37 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:37.209223 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c58dadb5-4e0c-47b0-a6e6-3231cc281b11 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:37.209761 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c58dadb5-4e0c-47b0-a6e6-3231cc281b11 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:37.210549 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c58dadb5-4e0c-47b0-a6e6-3231cc281b11 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:37.210986 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c58dadb5-4e0c-47b0-a6e6-3231cc281b11 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:37.242947 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c58dadb5-4e0c-47b0-a6e6-3231cc281b11 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046026 May 19 12:24:37.243508 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 320/694] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:24:37 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:24:38.082463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-13d18e10-f3e2-469c-84c0-5eaa87d453fb tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:38.083065 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-13d18e10-f3e2-469c-84c0-5eaa87d453fb tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:38.089812 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-13d18e10-f3e2-469c-84c0-5eaa87d453fb tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:38.090261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-13d18e10-f3e2-469c-84c0-5eaa87d453fb tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:38.091022 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-13d18e10-f3e2-469c-84c0-5eaa87d453fb tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:38.091462 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-13d18e10-f3e2-469c-84c0-5eaa87d453fb tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:38.226225 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-54508c9c-a9fb-4ab0-a17f-0518462ab5fa tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:38.226804 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-54508c9c-a9fb-4ab0-a17f-0518462ab5fa tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:38.231389 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-13d18e10-f3e2-469c-84c0-5eaa87d453fb tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:38.233317 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-54508c9c-a9fb-4ab0-a17f-0518462ab5fa tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:38.233764 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-54508c9c-a9fb-4ab0-a17f-0518462ab5fa tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:38.234779 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-54508c9c-a9fb-4ab0-a17f-0518462ab5fa tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:38.235208 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-54508c9c-a9fb-4ab0-a17f-0518462ab5fa tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:38.240746 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-13d18e10-f3e2-469c-84c0-5eaa87d453fb tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1756 microversion: 2.1 time: 0.162126 May 19 12:24:38.241419 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 375/695] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:38 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:38.254674 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7936596d-1699-4f2d-bded-c1f464a72357 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:38.255646 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7936596d-1699-4f2d-bded-c1f464a72357 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:38.261719 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7936596d-1699-4f2d-bded-c1f464a72357 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:38.262165 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7936596d-1699-4f2d-bded-c1f464a72357 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:38.262931 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7936596d-1699-4f2d-bded-c1f464a72357 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:38.263361 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7936596d-1699-4f2d-bded-c1f464a72357 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:38.294904 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7936596d-1699-4f2d-bded-c1f464a72357 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044195 May 19 12:24:38.295748 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 376/696] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:24:38 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:38.373014 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-54508c9c-a9fb-4ab0-a17f-0518462ab5fa tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:38.380845 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-54508c9c-a9fb-4ab0-a17f-0518462ab5fa tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1681 microversion: 2.1 time: 0.159276 May 19 12:24:38.381421 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 321/697] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:38 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:39.259691 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ecaec178-f734-4601-a1a2-75fb3202e388 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:39.260555 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ecaec178-f734-4601-a1a2-75fb3202e388 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:39.267958 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ecaec178-f734-4601-a1a2-75fb3202e388 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:39.268408 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ecaec178-f734-4601-a1a2-75fb3202e388 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:39.269272 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ecaec178-f734-4601-a1a2-75fb3202e388 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:39.269739 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ecaec178-f734-4601-a1a2-75fb3202e388 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:39.307820 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0a67b996-f4d7-45b0-ab60-751144005dbc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:39.309584 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0a67b996-f4d7-45b0-ab60-751144005dbc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:39.317906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0a67b996-f4d7-45b0-ab60-751144005dbc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:39.321051 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0a67b996-f4d7-45b0-ab60-751144005dbc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:39.321051 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0a67b996-f4d7-45b0-ab60-751144005dbc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:39.321051 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0a67b996-f4d7-45b0-ab60-751144005dbc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:39.351986 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0a67b996-f4d7-45b0-ab60-751144005dbc tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048540 May 19 12:24:39.357372 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 322/698] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:24:39 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 12:24:39.401275 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d7d3b1d1-ea03-44cc-b8e7-93c5ab72be92 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:39.401992 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d7d3b1d1-ea03-44cc-b8e7-93c5ab72be92 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:39.421700 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d7d3b1d1-ea03-44cc-b8e7-93c5ab72be92 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:39.422263 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d7d3b1d1-ea03-44cc-b8e7-93c5ab72be92 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:39.422942 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d7d3b1d1-ea03-44cc-b8e7-93c5ab72be92 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:39.423386 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d7d3b1d1-ea03-44cc-b8e7-93c5ab72be92 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:39.438633 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ecaec178-f734-4601-a1a2-75fb3202e388 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:39.464500 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ecaec178-f734-4601-a1a2-75fb3202e388 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1756 microversion: 2.1 time: 0.202737 May 19 12:24:39.465315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 377/699] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:39 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1756 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:39.479190 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-81f43296-a7d4-4e2b-b50b-985c81a4d98c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:39.480144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-81f43296-a7d4-4e2b-b50b-985c81a4d98c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:39.494295 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-81f43296-a7d4-4e2b-b50b-985c81a4d98c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:39.495024 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-81f43296-a7d4-4e2b-b50b-985c81a4d98c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:39.495852 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-81f43296-a7d4-4e2b-b50b-985c81a4d98c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:39.497306 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-81f43296-a7d4-4e2b-b50b-985c81a4d98c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:39.510809 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d7d3b1d1-ea03-44cc-b8e7-93c5ab72be92 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:39.519991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d7d3b1d1-ea03-44cc-b8e7-93c5ab72be92 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1613 microversion: 2.1 time: 0.124909 May 19 12:24:39.520487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 323/700] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:39 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1613 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:39.539173 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-81f43296-a7d4-4e2b-b50b-985c81a4d98c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:24:39.603502 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-fa1d1c40-cad7-4692-9e37-1749d810508d req-51027f1c-7ffb-42f4-8891-1ca4dd6f8c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cac13b6-2524-4f4b-879d-0e6723932d04", "name": "network-vif-deleted", "tag": "4d47e479-3475-4012-b86f-9a5b42aaddf7"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:39.612613 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-fa1d1c40-cad7-4692-9e37-1749d810508d req-51027f1c-7ffb-42f4-8891-1ca4dd6f8c55 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:39.613122 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-fa1d1c40-cad7-4692-9e37-1749d810508d req-51027f1c-7ffb-42f4-8891-1ca4dd6f8c55 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:39.626137 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-fa1d1c40-cad7-4692-9e37-1749d810508d req-51027f1c-7ffb-42f4-8891-1ca4dd6f8c55 service nova] Creating event network-vif-deleted:4d47e479-3475-4012-b86f-9a5b42aaddf7 for instance 8cac13b6-2524-4f4b-879d-0e6723932d04 on hv-cinder-80475 May 19 12:24:39.631814 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-fa1d1c40-cad7-4692-9e37-1749d810508d req-51027f1c-7ffb-42f4-8891-1ca4dd6f8c55 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109829 May 19 12:24:39.632421 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 324/701] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:39.940560 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-81f43296-a7d4-4e2b-b50b-985c81a4d98c tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "DELETE /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 204 len: 0 microversion: 2.1 time: 0.473742 May 19 12:24:39.950941 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 378/702] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:24:39 2022] DELETE /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:24:39.961654 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-15b1322e-fd2a-46a7-853c-8d714287b6f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:39.962555 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-15b1322e-fd2a-46a7-853c-8d714287b6f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:39.970168 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-15b1322e-fd2a-46a7-853c-8d714287b6f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:39.970687 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-15b1322e-fd2a-46a7-853c-8d714287b6f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:39.971700 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-15b1322e-fd2a-46a7-853c-8d714287b6f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:39.972526 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-15b1322e-fd2a-46a7-853c-8d714287b6f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:40.120414 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-15b1322e-fd2a-46a7-853c-8d714287b6f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:40.128910 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-15b1322e-fd2a-46a7-853c-8d714287b6f8 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1691 microversion: 2.1 time: 0.173327 May 19 12:24:40.129529 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 325/703] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:39 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:40.483289 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9f069c8d-9760-47ac-98ab-ce631ec1280b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:40.484378 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9f069c8d-9760-47ac-98ab-ce631ec1280b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:40.491991 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9f069c8d-9760-47ac-98ab-ce631ec1280b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:40.492448 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9f069c8d-9760-47ac-98ab-ce631ec1280b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:40.493254 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9f069c8d-9760-47ac-98ab-ce631ec1280b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:40.493688 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9f069c8d-9760-47ac-98ab-ce631ec1280b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:40.537276 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-daf481aa-1fcd-44c2-a255-f231b8c8f040 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:40.537889 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-daf481aa-1fcd-44c2-a255-f231b8c8f040 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:40.544684 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-daf481aa-1fcd-44c2-a255-f231b8c8f040 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:40.545368 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-daf481aa-1fcd-44c2-a255-f231b8c8f040 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:40.546310 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-daf481aa-1fcd-44c2-a255-f231b8c8f040 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:40.546924 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-daf481aa-1fcd-44c2-a255-f231b8c8f040 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:40.585768 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-daf481aa-1fcd-44c2-a255-f231b8c8f040 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:40.586347 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-daf481aa-1fcd-44c2-a255-f231b8c8f040 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:40.586928 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.objects.instance [None req-daf481aa-1fcd-44c2-a255-f231b8c8f040 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lazy-loading 'fault' on Instance uuid 8cac13b6-2524-4f4b-879d-0e6723932d04 {{(pid=117964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:24:40.644547 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-daf481aa-1fcd-44c2-a255-f231b8c8f040 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:40.653596 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-daf481aa-1fcd-44c2-a255-f231b8c8f040 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1331 microversion: 2.1 time: 0.120114 May 19 12:24:40.659449 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 326/704] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:40 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1331 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:40.686713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9f069c8d-9760-47ac-98ab-ce631ec1280b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:40.690152 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9f069c8d-9760-47ac-98ab-ce631ec1280b tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1756 microversion: 2.1 time: 0.211244 May 19 12:24:40.690725 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 379/705] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:40 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1756 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:41.146908 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-84a66fce-d096-4ace-8982-620f0a3fe5b1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:41.147555 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-84a66fce-d096-4ace-8982-620f0a3fe5b1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:41.154267 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-84a66fce-d096-4ace-8982-620f0a3fe5b1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:41.154710 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-84a66fce-d096-4ace-8982-620f0a3fe5b1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:41.155485 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-84a66fce-d096-4ace-8982-620f0a3fe5b1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:41.155948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-84a66fce-d096-4ace-8982-620f0a3fe5b1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:41.314222 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-84a66fce-d096-4ace-8982-620f0a3fe5b1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:41.318647 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:41.323078 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-84a66fce-d096-4ace-8982-620f0a3fe5b1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1691 microversion: 2.1 time: 0.180699 May 19 12:24:41.323688 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 327/706] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:41 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:41.671861 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-516a87e5-94b8-4ace-b549-5379275bee26 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:41.672450 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-516a87e5-94b8-4ace-b549-5379275bee26 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:41.679756 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-516a87e5-94b8-4ace-b549-5379275bee26 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:41.680229 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-516a87e5-94b8-4ace-b549-5379275bee26 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:41.680991 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-516a87e5-94b8-4ace-b549-5379275bee26 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:41.681428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-516a87e5-94b8-4ace-b549-5379275bee26 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:41.708531 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-19252487-1fcf-4e16-b0ce-8266905f4134 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:41.713720 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-19252487-1fcf-4e16-b0ce-8266905f4134 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:41.713863 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-516a87e5-94b8-4ace-b549-5379275bee26 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:41.713969 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-516a87e5-94b8-4ace-b549-5379275bee26 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:41.714421 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-516a87e5-94b8-4ace-b549-5379275bee26 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lazy-loading 'fault' on Instance uuid 8cac13b6-2524-4f4b-879d-0e6723932d04 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:24:41.717801 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-19252487-1fcf-4e16-b0ce-8266905f4134 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:41.718241 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-19252487-1fcf-4e16-b0ce-8266905f4134 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:41.719208 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-19252487-1fcf-4e16-b0ce-8266905f4134 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:41.719943 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-19252487-1fcf-4e16-b0ce-8266905f4134 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:41.760684 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-516a87e5-94b8-4ace-b549-5379275bee26 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:41.765779 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-516a87e5-94b8-4ace-b549-5379275bee26 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1331 microversion: 2.1 time: 0.097799 May 19 12:24:41.766359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 380/707] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:41 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:41.877644 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-19252487-1fcf-4e16-b0ce-8266905f4134 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:41.886614 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-19252487-1fcf-4e16-b0ce-8266905f4134 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1756 microversion: 2.1 time: 0.182206 May 19 12:24:41.887438 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 328/708] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:41 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:42.340846 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3627801d-328b-41ab-9fc3-6e6802caec91 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:42.341462 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3627801d-328b-41ab-9fc3-6e6802caec91 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:42.348757 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3627801d-328b-41ab-9fc3-6e6802caec91 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:42.349024 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3627801d-328b-41ab-9fc3-6e6802caec91 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:42.349624 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3627801d-328b-41ab-9fc3-6e6802caec91 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:42.350061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3627801d-328b-41ab-9fc3-6e6802caec91 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:42.490812 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3627801d-328b-41ab-9fc3-6e6802caec91 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:42.498328 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3627801d-328b-41ab-9fc3-6e6802caec91 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1691 microversion: 2.1 time: 0.161462 May 19 12:24:42.499676 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 381/709] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:42 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:42.782665 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c5ec0be4-a41c-4c1d-8a99-5519b41622a6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:42.783278 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c5ec0be4-a41c-4c1d-8a99-5519b41622a6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:42.790098 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c5ec0be4-a41c-4c1d-8a99-5519b41622a6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:42.790552 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c5ec0be4-a41c-4c1d-8a99-5519b41622a6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:42.791323 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c5ec0be4-a41c-4c1d-8a99-5519b41622a6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:42.791809 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c5ec0be4-a41c-4c1d-8a99-5519b41622a6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:42.823208 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c5ec0be4-a41c-4c1d-8a99-5519b41622a6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:42.823657 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c5ec0be4-a41c-4c1d-8a99-5519b41622a6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:42.824140 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.objects.instance [None req-c5ec0be4-a41c-4c1d-8a99-5519b41622a6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lazy-loading 'fault' on Instance uuid 8cac13b6-2524-4f4b-879d-0e6723932d04 {{(pid=117964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:24:42.865129 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c5ec0be4-a41c-4c1d-8a99-5519b41622a6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:42.872820 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c5ec0be4-a41c-4c1d-8a99-5519b41622a6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1331 microversion: 2.1 time: 0.094120 May 19 12:24:42.873392 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 329/710] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:42 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:42.904744 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8cd79b6b-d347-4a51-a05b-81322743bd29 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:42.905384 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8cd79b6b-d347-4a51-a05b-81322743bd29 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:42.912069 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8cd79b6b-d347-4a51-a05b-81322743bd29 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:42.912520 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8cd79b6b-d347-4a51-a05b-81322743bd29 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:42.913288 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8cd79b6b-d347-4a51-a05b-81322743bd29 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:42.913725 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8cd79b6b-d347-4a51-a05b-81322743bd29 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:42.932851 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:43.060855 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8cd79b6b-d347-4a51-a05b-81322743bd29 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:43.069986 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8cd79b6b-d347-4a51-a05b-81322743bd29 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1756 microversion: 2.1 time: 0.168983 May 19 12:24:43.070548 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 382/711] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:42 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:43.514859 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-91ebbe1a-defe-4234-b026-a1a3029f7ee6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:43.515490 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-91ebbe1a-defe-4234-b026-a1a3029f7ee6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:43.521726 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-91ebbe1a-defe-4234-b026-a1a3029f7ee6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:43.522169 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-91ebbe1a-defe-4234-b026-a1a3029f7ee6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:43.522936 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-91ebbe1a-defe-4234-b026-a1a3029f7ee6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:43.523370 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-91ebbe1a-defe-4234-b026-a1a3029f7ee6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:43.655128 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-91ebbe1a-defe-4234-b026-a1a3029f7ee6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:43.663595 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-91ebbe1a-defe-4234-b026-a1a3029f7ee6 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1691 microversion: 2.1 time: 0.152592 May 19 12:24:43.664200 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 330/712] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:43 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:43.890392 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b21eac5a-4937-4534-b67c-c3c46a73715c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:43.891000 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b21eac5a-4937-4534-b67c-c3c46a73715c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:43.897916 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b21eac5a-4937-4534-b67c-c3c46a73715c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:43.898359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b21eac5a-4937-4534-b67c-c3c46a73715c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:43.899111 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b21eac5a-4937-4534-b67c-c3c46a73715c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:43.899542 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b21eac5a-4937-4534-b67c-c3c46a73715c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:43.931551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b21eac5a-4937-4534-b67c-c3c46a73715c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:43.932196 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b21eac5a-4937-4534-b67c-c3c46a73715c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:43.932467 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-b21eac5a-4937-4534-b67c-c3c46a73715c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lazy-loading 'fault' on Instance uuid 8cac13b6-2524-4f4b-879d-0e6723932d04 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:24:43.974114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b21eac5a-4937-4534-b67c-c3c46a73715c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:43.981648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b21eac5a-4937-4534-b67c-c3c46a73715c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 200 len: 1331 microversion: 2.1 time: 0.095115 May 19 12:24:43.982207 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 383/713] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:43 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:44.087238 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-234a07df-3bb4-4e8f-8691-2b3ee273adda tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:44.087976 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-234a07df-3bb4-4e8f-8691-2b3ee273adda tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:44.094534 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-234a07df-3bb4-4e8f-8691-2b3ee273adda tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:44.094987 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-234a07df-3bb4-4e8f-8691-2b3ee273adda tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:44.095756 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-234a07df-3bb4-4e8f-8691-2b3ee273adda tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:44.096216 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-234a07df-3bb4-4e8f-8691-2b3ee273adda tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:44.249127 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-234a07df-3bb4-4e8f-8691-2b3ee273adda tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:44.257965 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-234a07df-3bb4-4e8f-8691-2b3ee273adda tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1756 microversion: 2.1 time: 0.174588 May 19 12:24:44.258521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 331/714] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:44 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:44.680846 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bdfd5f05-648c-4185-a62c-8eb008e99c0f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:44.681459 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bdfd5f05-648c-4185-a62c-8eb008e99c0f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:44.687892 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bdfd5f05-648c-4185-a62c-8eb008e99c0f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:44.688352 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bdfd5f05-648c-4185-a62c-8eb008e99c0f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:44.689139 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bdfd5f05-648c-4185-a62c-8eb008e99c0f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:44.689574 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bdfd5f05-648c-4185-a62c-8eb008e99c0f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:44.820073 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bdfd5f05-648c-4185-a62c-8eb008e99c0f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:44.828126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bdfd5f05-648c-4185-a62c-8eb008e99c0f tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1691 microversion: 2.1 time: 0.151144 May 19 12:24:44.828708 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 384/715] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:44 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:44.998698 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-aa91c3ee-b065-428a-a4ff-b173dec90b75 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:44.999308 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-aa91c3ee-b065-428a-a4ff-b173dec90b75 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:45.006918 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-aa91c3ee-b065-428a-a4ff-b173dec90b75 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:45.007360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-aa91c3ee-b065-428a-a4ff-b173dec90b75 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:45.008344 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-aa91c3ee-b065-428a-a4ff-b173dec90b75 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:45.008785 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-aa91c3ee-b065-428a-a4ff-b173dec90b75 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:45.023508 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-aa91c3ee-b065-428a-a4ff-b173dec90b75 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] HTTP exception thrown: Instance 8cac13b6-2524-4f4b-879d-0e6723932d04 could not be found. May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-aa91c3ee-b065-428a-a4ff-b173dec90b75 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Request method failure captured: May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 HTTP/1.1 May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjWEBNF2DeurAd4vIS9t5sXixknAa9oMvXKGIT7BVlMgRbph3mSe132nYVois5KyltYyb0JHe3nInO6bVt7M3Z2oZ1xRzJyjOamBOcNMxIEvcJ1cyR56gBj_EXYQnPZDcjZT6Ja0FtOHx4Rd4HuWodV9rlQ_CBw1MTfirEySyppbNDw May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:24:45.025107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:24:45.026629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2de86d602945238f5df0e2c388004f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:24:45.026629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-AttachVolumeNegativeTest-50904330 May 19 12:24:45.026629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:24:45.026629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:24:45.026629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:24:45.026629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:24:45.026629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:24:45.026629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: dd39ddcf4ab045b98a737ee529a2dcce May 19 12:24:45.026629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:24:45.026629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:24:45.026629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance 8cac13b6-2524-4f4b-879d-0e6723932d04 could not be found. May 19 12:24:45.026629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': '8cac13b6-2524-4f4b-879d-0e6723932d04'} May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cac13b6-2524-4f4b-879d-0e6723932d04 could not be found. May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:24:45.027356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:24:45.028674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:24:45.028674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:24:45.028674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:24:45.028674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:24:45.028674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:24:45.028674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:24:45.028674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:24:45.028674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cac13b6-2524-4f4b-879d-0e6723932d04 could not be found. May 19 12:24:45.028674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:24:45.028674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:24:45.028674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:24:45.028674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:24:45.028674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:24:45.028674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:24:45.028674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:24:45.028674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:24:45.028674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cac13b6-2524-4f4b-879d-0e6723932d04 could not be found. May 19 12:24:45.028674 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:24:45.029759 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-aa91c3ee-b065-428a-a4ff-b173dec90b75 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Returning 404 to user: Instance 8cac13b6-2524-4f4b-879d-0e6723932d04 could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:24:45.029759 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-aa91c3ee-b065-428a-a4ff-b173dec90b75 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 404 len: 111 microversion: 2.1 time: 0.031828 May 19 12:24:45.029759 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 332/716] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:44 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:24:45.036502 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1c83072c-c0a2-46ac-8b46-004026eb9469 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '.version_select at 0x7f3ba2a87c10>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:45.136972 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1c83072c-c0a2-46ac-8b46-004026eb9469 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-140819421" status: 202 len: 0 microversion: 2.1 time: 0.104730 May 19 12:24:45.137641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 385/717] 10.222.0.23 () {58 vars in 1217 bytes} [Thu May 19 12:24:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-140819421 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:24:45.146227 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-ffa7db4c-536c-4a52-bd65-f6ba4f2837f5 req-61ea85b8-4ecb-4ca5-b1f2-0bd6d0b6737d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caffcacb-8fb4-412e-ae78-67570b491068", "name": "network-vif-deleted", "tag": "413f04d8-4ef0-4bef-8ee6-725aaa428db9"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:45.156320 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-ffa7db4c-536c-4a52-bd65-f6ba4f2837f5 req-61ea85b8-4ecb-4ca5-b1f2-0bd6d0b6737d service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:45.156772 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-ffa7db4c-536c-4a52-bd65-f6ba4f2837f5 req-61ea85b8-4ecb-4ca5-b1f2-0bd6d0b6737d service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:45.169142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-ffa7db4c-536c-4a52-bd65-f6ba4f2837f5 req-61ea85b8-4ecb-4ca5-b1f2-0bd6d0b6737d service nova] Creating event network-vif-deleted:413f04d8-4ef0-4bef-8ee6-725aaa428db9 for instance caffcacb-8fb4-412e-ae78-67570b491068 on hv-cinder-80475 May 19 12:24:45.179302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-ffa7db4c-536c-4a52-bd65-f6ba4f2837f5 req-61ea85b8-4ecb-4ca5-b1f2-0bd6d0b6737d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036801 May 19 12:24:45.183413 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 333/718] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:45.275530 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c1e3ec44-c393-4114-ad96-4b39aac02076 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:45.276596 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c1e3ec44-c393-4114-ad96-4b39aac02076 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:45.287462 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c1e3ec44-c393-4114-ad96-4b39aac02076 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:45.288160 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c1e3ec44-c393-4114-ad96-4b39aac02076 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:45.289114 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c1e3ec44-c393-4114-ad96-4b39aac02076 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:45.289871 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c1e3ec44-c393-4114-ad96-4b39aac02076 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:45.537545 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c1e3ec44-c393-4114-ad96-4b39aac02076 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:45.547365 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c1e3ec44-c393-4114-ad96-4b39aac02076 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1759 microversion: 2.1 time: 0.275805 May 19 12:24:45.548284 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 386/719] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:45 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1759 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:45.846539 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-3e416991-efcc-46fa-bb7f-b5c1a872cff1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:45.847220 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-3e416991-efcc-46fa-bb7f-b5c1a872cff1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:45.854606 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3e416991-efcc-46fa-bb7f-b5c1a872cff1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:45.855059 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3e416991-efcc-46fa-bb7f-b5c1a872cff1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:45.855857 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3e416991-efcc-46fa-bb7f-b5c1a872cff1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:45.856299 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3e416991-efcc-46fa-bb7f-b5c1a872cff1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:45.889249 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3e416991-efcc-46fa-bb7f-b5c1a872cff1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:45.889703 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3e416991-efcc-46fa-bb7f-b5c1a872cff1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:45.890159 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.objects.instance [None req-3e416991-efcc-46fa-bb7f-b5c1a872cff1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lazy-loading 'fault' on Instance uuid caffcacb-8fb4-412e-ae78-67570b491068 {{(pid=117964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:24:45.955889 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-3e416991-efcc-46fa-bb7f-b5c1a872cff1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:45.965476 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-3e416991-efcc-46fa-bb7f-b5c1a872cff1 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1336 microversion: 2.1 time: 0.123104 May 19 12:24:45.967011 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 334/720] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:45 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1336 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:46.078790 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a210e115-7251-471a-a891-05c43af8c4f5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:46.080444 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a210e115-7251-471a-a891-05c43af8c4f5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:46.088797 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a210e115-7251-471a-a891-05c43af8c4f5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:46.093528 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a210e115-7251-471a-a891-05c43af8c4f5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:46.093528 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a210e115-7251-471a-a891-05c43af8c4f5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:46.093528 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a210e115-7251-471a-a891-05c43af8c4f5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:46.184042 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-a210e115-7251-471a-a891-05c43af8c4f5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lazy-loading 'services' on Instance uuid 51363d7f-7d31-427b-87c1-fa437e713d85 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:24:46.502333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a210e115-7251-471a-a891-05c43af8c4f5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "DELETE /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85/os-volume_attachments/df9d793b-c31e-4feb-9ebb-651e35ef8881" status: 202 len: 0 microversion: 2.1 time: 0.426861 May 19 12:24:46.503680 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 387/721] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 19 12:24:46 2022] DELETE /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85/os-volume_attachments/df9d793b-c31e-4feb-9ebb-651e35ef8881 => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:24:46.518335 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6b18740c-c367-474b-a154-da9aaa404c9f tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:46.520086 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6b18740c-c367-474b-a154-da9aaa404c9f tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:46.528934 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6b18740c-c367-474b-a154-da9aaa404c9f tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:46.529386 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6b18740c-c367-474b-a154-da9aaa404c9f tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:46.531501 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6b18740c-c367-474b-a154-da9aaa404c9f tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:46.531501 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6b18740c-c367-474b-a154-da9aaa404c9f tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:46.566741 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6b18740c-c367-474b-a154-da9aaa404c9f tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056329 May 19 12:24:46.567313 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 335/722] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:24:46 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:46.983691 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-40c4b08d-39df-4612-854d-e7e76dc257e5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:46.984598 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-40c4b08d-39df-4612-854d-e7e76dc257e5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:46.991358 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-40c4b08d-39df-4612-854d-e7e76dc257e5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:46.991823 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-40c4b08d-39df-4612-854d-e7e76dc257e5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:46.992595 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-40c4b08d-39df-4612-854d-e7e76dc257e5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:46.993034 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-40c4b08d-39df-4612-854d-e7e76dc257e5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:47.025076 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-40c4b08d-39df-4612-854d-e7e76dc257e5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:47.025536 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-40c4b08d-39df-4612-854d-e7e76dc257e5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:47.025968 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-40c4b08d-39df-4612-854d-e7e76dc257e5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lazy-loading 'fault' on Instance uuid caffcacb-8fb4-412e-ae78-67570b491068 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:24:47.070696 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-40c4b08d-39df-4612-854d-e7e76dc257e5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:47.078702 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-40c4b08d-39df-4612-854d-e7e76dc257e5 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 200 len: 1336 microversion: 2.1 time: 0.099447 May 19 12:24:47.079320 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 388/723] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:46 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 1336 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:47.578775 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c1456081-b2f9-42e4-91ff-5c7c02547dc5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:47.579739 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c1456081-b2f9-42e4-91ff-5c7c02547dc5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:47.587062 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c1456081-b2f9-42e4-91ff-5c7c02547dc5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:47.589968 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c1456081-b2f9-42e4-91ff-5c7c02547dc5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:47.589968 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c1456081-b2f9-42e4-91ff-5c7c02547dc5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:47.589968 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c1456081-b2f9-42e4-91ff-5c7c02547dc5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:47.619181 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c1456081-b2f9-42e4-91ff-5c7c02547dc5 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044423 May 19 12:24:47.619749 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 336/724] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:24:47 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:48.094961 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f24cf49b-63cc-4d02-a92d-62f0d90e3411 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:48.095565 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f24cf49b-63cc-4d02-a92d-62f0d90e3411 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: caffcacb-8fb4-412e-ae78-67570b491068] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:48.103875 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f24cf49b-63cc-4d02-a92d-62f0d90e3411 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:48.103875 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f24cf49b-63cc-4d02-a92d-62f0d90e3411 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:48.103875 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f24cf49b-63cc-4d02-a92d-62f0d90e3411 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:48.104207 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f24cf49b-63cc-4d02-a92d-62f0d90e3411 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:48.117723 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-f24cf49b-63cc-4d02-a92d-62f0d90e3411 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] HTTP exception thrown: Instance caffcacb-8fb4-412e-ae78-67570b491068 could not be found. May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f24cf49b-63cc-4d02-a92d-62f0d90e3411 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Request method failure captured: May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 HTTP/1.1 May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjV3ba4_uVlBVIvh_bBreMWZSJM2U80SltnInJem3RpmUyDvutWhoUewS7KziAUbwrvECCf0a_6rYJitU_iO6aJz7Ech1mVe-8aUkQ9TDBlP73buFXKQkkHjg5gljrCoIVxKLRParuGEmqFHmsydgfqVGrlueaFfskHreMvIm9Etqy8 May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: b3d651a605fd4dee95797a7ec3896792 May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1292733612 May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:24:48.119356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:24:48.121034 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:24:48.121034 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1292733612 May 19 12:24:48.121034 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: b3d651a605fd4dee95797a7ec3896792 May 19 12:24:48.121034 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1292733612 May 19 12:24:48.121034 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-ServerRescueNegativeTestJSON-1292733612-project May 19 12:24:48.121034 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:24:48.121034 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:24:48.121034 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: 8e445569dc5641ed962b0ac977850a6c May 19 12:24:48.121034 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1292733612-project May 19 12:24:48.121034 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:24:48.121034 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance caffcacb-8fb4-412e-ae78-67570b491068 could not be found. May 19 12:24:48.121034 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': 'caffcacb-8fb4-412e-ae78-67570b491068'} May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caffcacb-8fb4-412e-ae78-67570b491068 could not be found. May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:24:48.121979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:24:48.123339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:24:48.123339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:24:48.123339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:24:48.123339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:24:48.123339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:24:48.123339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:24:48.123339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:24:48.123339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caffcacb-8fb4-412e-ae78-67570b491068 could not be found. May 19 12:24:48.123339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:24:48.123339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:24:48.123339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:24:48.123339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:24:48.123339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:24:48.123339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:24:48.123339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:24:48.123339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:24:48.123339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caffcacb-8fb4-412e-ae78-67570b491068 could not be found. May 19 12:24:48.123339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:24:48.124729 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f24cf49b-63cc-4d02-a92d-62f0d90e3411 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Returning 404 to user: Instance caffcacb-8fb4-412e-ae78-67570b491068 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:24:48.124729 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f24cf49b-63cc-4d02-a92d-62f0d90e3411 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068" status: 404 len: 111 microversion: 2.1 time: 0.029704 May 19 12:24:48.124729 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 389/725] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:48 2022] GET /compute/v2.1/servers/caffcacb-8fb4-412e-ae78-67570b491068 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:24:48.130757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b342d4ab-74ec-4950-b76b-cf8ed4570753 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '.version_select at 0x7f3ba2a0adc0>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:48.134007 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b342d4ab-74ec-4950-b76b-cf8ed4570753 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [cb389603-6aa5-4bca-a74c-51a65b171942] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 12:24:48.631356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4b8dc2f4-c28c-4991-9083-8945b3202c52 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:48.632383 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4b8dc2f4-c28c-4991-9083-8945b3202c52 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:48.638454 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4b8dc2f4-c28c-4991-9083-8945b3202c52 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:48.638902 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4b8dc2f4-c28c-4991-9083-8945b3202c52 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:48.639655 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4b8dc2f4-c28c-4991-9083-8945b3202c52 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:48.640111 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4b8dc2f4-c28c-4991-9083-8945b3202c52 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:48.669810 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4b8dc2f4-c28c-4991-9083-8945b3202c52 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042875 May 19 12:24:48.670257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 390/726] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:24:48 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 12:24:48.727857 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ddfe9d7d-cf1f-490d-bb44-773c34aa7791 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:48.728363 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ddfe9d7d-cf1f-490d-bb44-773c34aa7791 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:48.734859 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ddfe9d7d-cf1f-490d-bb44-773c34aa7791 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:48.739385 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ddfe9d7d-cf1f-490d-bb44-773c34aa7791 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:48.739385 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ddfe9d7d-cf1f-490d-bb44-773c34aa7791 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:48.739385 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ddfe9d7d-cf1f-490d-bb44-773c34aa7791 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:48.762416 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ddfe9d7d-cf1f-490d-bb44-773c34aa7791 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:24:49.101092 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ddfe9d7d-cf1f-490d-bb44-773c34aa7791 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "DELETE /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 204 len: 0 microversion: 2.1 time: 0.376891 May 19 12:24:49.101768 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 391/727] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:24:48 2022] DELETE /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 12:24:49.110682 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d0493a95-5a98-42a5-85d2-70aad4bc8bf1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:49.111372 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d0493a95-5a98-42a5-85d2-70aad4bc8bf1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:49.119008 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d0493a95-5a98-42a5-85d2-70aad4bc8bf1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:49.119456 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d0493a95-5a98-42a5-85d2-70aad4bc8bf1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:49.120264 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d0493a95-5a98-42a5-85d2-70aad4bc8bf1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:49.120694 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d0493a95-5a98-42a5-85d2-70aad4bc8bf1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:49.142094 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO oslo.messaging._drivers.impl_rabbit [None req-b342d4ab-74ec-4950-b76b-cf8ed4570753 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [cb389603-6aa5-4bca-a74c-51a65b171942] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 52148. May 19 12:24:49.243147 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b342d4ab-74ec-4950-b76b-cf8ed4570753 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1933962819" status: 202 len: 0 microversion: 2.1 time: 1.117170 May 19 12:24:49.244077 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 337/728] 10.222.0.23 () {58 vars in 1220 bytes} [Thu May 19 12:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1933962819 => generated 0 bytes in 1119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:24:49.258377 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d0493a95-5a98-42a5-85d2-70aad4bc8bf1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:49.266220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d0493a95-5a98-42a5-85d2-70aad4bc8bf1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1680 microversion: 2.1 time: 0.159884 May 19 12:24:49.266797 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 392/729] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:49 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:50.283068 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d18c2fb0-a3f8-4842-b63b-9e7c674f6721 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:50.283673 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d18c2fb0-a3f8-4842-b63b-9e7c674f6721 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:50.292326 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d18c2fb0-a3f8-4842-b63b-9e7c674f6721 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:50.292779 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d18c2fb0-a3f8-4842-b63b-9e7c674f6721 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:50.293626 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d18c2fb0-a3f8-4842-b63b-9e7c674f6721 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:50.294066 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d18c2fb0-a3f8-4842-b63b-9e7c674f6721 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:50.432955 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d18c2fb0-a3f8-4842-b63b-9e7c674f6721 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:50.440765 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d18c2fb0-a3f8-4842-b63b-9e7c674f6721 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1680 microversion: 2.1 time: 0.162048 May 19 12:24:50.444319 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 338/730] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:50 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:51.258747 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-b1249ce3-a4db-4997-8ab0-8cc9b115101a req-2b2e5b40-ed46-4c91-8654-623340d502f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51363d7f-7d31-427b-87c1-fa437e713d85", "name": "network-vif-deleted", "tag": "a5bc79ff-3cb4-40ee-b6c7-d0520edd0a76"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:51.264946 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-b1249ce3-a4db-4997-8ab0-8cc9b115101a req-2b2e5b40-ed46-4c91-8654-623340d502f8 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:51.265416 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-b1249ce3-a4db-4997-8ab0-8cc9b115101a req-2b2e5b40-ed46-4c91-8654-623340d502f8 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:51.279851 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-b1249ce3-a4db-4997-8ab0-8cc9b115101a req-2b2e5b40-ed46-4c91-8654-623340d502f8 service nova] Creating event network-vif-deleted:a5bc79ff-3cb4-40ee-b6c7-d0520edd0a76 for instance 51363d7f-7d31-427b-87c1-fa437e713d85 on hv-cinder-80475 May 19 12:24:51.284958 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-b1249ce3-a4db-4997-8ab0-8cc9b115101a req-2b2e5b40-ed46-4c91-8654-623340d502f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033254 May 19 12:24:51.286265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 393/731] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:51.459902 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c09ec647-5f1d-40e5-abc1-b31678218b97 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:51.460520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c09ec647-5f1d-40e5-abc1-b31678218b97 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:51.468071 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c09ec647-5f1d-40e5-abc1-b31678218b97 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:51.468071 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c09ec647-5f1d-40e5-abc1-b31678218b97 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:51.468725 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c09ec647-5f1d-40e5-abc1-b31678218b97 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:51.469163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c09ec647-5f1d-40e5-abc1-b31678218b97 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:51.543406 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c09ec647-5f1d-40e5-abc1-b31678218b97 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:51.551263 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c09ec647-5f1d-40e5-abc1-b31678218b97 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 200 len: 1612 microversion: 2.1 time: 0.095848 May 19 12:24:51.552153 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 339/732] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:51 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 1612 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:52.570993 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-75a6765e-0f7e-4297-a109-c3102e3241cc tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:52.572156 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-75a6765e-0f7e-4297-a109-c3102e3241cc tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:52.580016 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-75a6765e-0f7e-4297-a109-c3102e3241cc tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:52.580506 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-75a6765e-0f7e-4297-a109-c3102e3241cc tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:52.581289 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-75a6765e-0f7e-4297-a109-c3102e3241cc tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:52.581733 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-75a6765e-0f7e-4297-a109-c3102e3241cc tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:52.597083 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-75a6765e-0f7e-4297-a109-c3102e3241cc tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] HTTP exception thrown: Instance 51363d7f-7d31-427b-87c1-fa437e713d85 could not be found. May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-75a6765e-0f7e-4297-a109-c3102e3241cc tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Request method failure captured: May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 HTTP/1.1 May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjWEBNF2DeurAd4vIS9t5sXixknAa9oMvXKGIT7BVlMgRbph3mSe132nYVois5KyltYyb0JHe3nInO6bVt7M3Z2oZ1xRzJyjOamBOcNMxIEvcJ1cyR56gBj_EXYQnPZDcjZT6Ja0FtOHx4Rd4HuWodV9rlQ_CBw1MTfirEySyppbNDw May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:24:52.599105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:24:52.600727 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2de86d602945238f5df0e2c388004f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:24:52.600727 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeNegativeTest-50904330 May 19 12:24:52.600727 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:24:52.600727 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:24:52.600727 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:24:52.600727 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:24:52.600727 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:24:52.600727 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: dd39ddcf4ab045b98a737ee529a2dcce May 19 12:24:52.600727 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:24:52.600727 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:24:52.600727 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance 51363d7f-7d31-427b-87c1-fa437e713d85 could not be found. May 19 12:24:52.600727 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': '51363d7f-7d31-427b-87c1-fa437e713d85'} May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51363d7f-7d31-427b-87c1-fa437e713d85 could not be found. May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:24:52.601563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:24:52.602847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:24:52.602847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:24:52.602847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:24:52.602847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:24:52.602847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:24:52.602847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:24:52.602847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:24:52.602847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51363d7f-7d31-427b-87c1-fa437e713d85 could not be found. May 19 12:24:52.602847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:24:52.602847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:24:52.602847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:24:52.602847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:24:52.602847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:24:52.602847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:24:52.602847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:24:52.602847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:24:52.602847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51363d7f-7d31-427b-87c1-fa437e713d85 could not be found. May 19 12:24:52.602847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:24:52.604015 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-75a6765e-0f7e-4297-a109-c3102e3241cc tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Returning 404 to user: Instance 51363d7f-7d31-427b-87c1-fa437e713d85 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:24:52.604015 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-75a6765e-0f7e-4297-a109-c3102e3241cc tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 404 len: 111 microversion: 2.1 time: 0.035578 May 19 12:24:52.604015 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 394/733] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:52 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:24:52.609920 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6dccd6dd-87e1-4202-a4c6-566aa6ceda2a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '.version_select at 0x7f3b9da54040>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:52.747014 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6dccd6dd-87e1-4202-a4c6-566aa6ceda2a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-880790417" status: 202 len: 0 microversion: 2.1 time: 0.141194 May 19 12:24:52.747521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 340/734] 10.222.0.23 () {58 vars in 1217 bytes} [Thu May 19 12:24:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-880790417 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:24:52.928787 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-517b8f0a-f13d-4f8b-9c30-296c2ecd1a19 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:52.929293 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-517b8f0a-f13d-4f8b-9c30-296c2ecd1a19 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:52.935400 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-517b8f0a-f13d-4f8b-9c30-296c2ecd1a19 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:52.935881 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-517b8f0a-f13d-4f8b-9c30-296c2ecd1a19 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:52.936656 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-517b8f0a-f13d-4f8b-9c30-296c2ecd1a19 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:52.937097 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-517b8f0a-f13d-4f8b-9c30-296c2ecd1a19 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:52.964298 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-517b8f0a-f13d-4f8b-9c30-296c2ecd1a19 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:24:53.337758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-517b8f0a-f13d-4f8b-9c30-296c2ecd1a19 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 204 len: 0 microversion: 2.1 time: 0.413200 May 19 12:24:53.338540 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 395/735] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:24:52 2022] DELETE /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:24:53.347007 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-7761875d-24a6-4753-ac78-890d8c17ecd9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:53.349505 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-7761875d-24a6-4753-ac78-890d8c17ecd9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:53.356241 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7761875d-24a6-4753-ac78-890d8c17ecd9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:53.364524 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7761875d-24a6-4753-ac78-890d8c17ecd9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:53.364524 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7761875d-24a6-4753-ac78-890d8c17ecd9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:53.364524 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7761875d-24a6-4753-ac78-890d8c17ecd9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:53.496457 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-7761875d-24a6-4753-ac78-890d8c17ecd9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:53.504359 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-7761875d-24a6-4753-ac78-890d8c17ecd9 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1507 microversion: 2.1 time: 0.161482 May 19 12:24:53.504947 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 341/736] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:53 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:53.805299 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6cdbac41-06ee-4965-aa53-936723cfb6ea tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Action: 'create', calling method: .version_select at 0x7f3b9d9581f0>, body: {"keypair": {"name": "tempest-keypair-1952522990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEFxG+eZsDNJUZcMYgUNwBD9iBm7SBHfad04VMdS3CePjmHRqrFWvyY6xJ5p+FGpnyp6bXRgtInUvVVd7Ex/CLHLV8Zwg/lilJHCv+uNzPPHutpbp2cCA4KFA1wpacBEA=="}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:53.820414 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-6cdbac41-06ee-4965-aa53-936723cfb6ea tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Getting quotas for project 1d2de86d602945238f5df0e2c388004f. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:24:53.824234 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-6cdbac41-06ee-4965-aa53-936723cfb6ea tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Getting quotas for user dd39ddcf4ab045b98a737ee529a2dcce and project 1d2de86d602945238f5df0e2c388004f. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:24:53.943077 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6cdbac41-06ee-4965-aa53-936723cfb6ea tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.142679 May 19 12:24:53.943685 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 396/737] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 19 12:24:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:54.521798 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e1f7807d-789f-44ac-8c56-80519b1e037a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:54.522413 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e1f7807d-789f-44ac-8c56-80519b1e037a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:54.529065 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e1f7807d-789f-44ac-8c56-80519b1e037a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:54.529516 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e1f7807d-789f-44ac-8c56-80519b1e037a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:54.530288 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e1f7807d-789f-44ac-8c56-80519b1e037a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:54.530725 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e1f7807d-789f-44ac-8c56-80519b1e037a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:54.667505 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e1f7807d-789f-44ac-8c56-80519b1e037a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:54.675193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e1f7807d-789f-44ac-8c56-80519b1e037a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1507 microversion: 2.1 time: 0.157506 May 19 12:24:54.678093 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 342/738] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:54 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:54.792970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-e3f5882e-6ac0-4989-a228-29e705b2a72b req-f2928945-0dc1-4d78-be7e-716ba47f1310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c735043f-0342-49b4-9be8-ee27f994a3ed", "name": "network-vif-deleted", "tag": "fbbeac60-78b3-4a87-9aeb-fdf2a2c8957f"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:54.804256 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-e3f5882e-6ac0-4989-a228-29e705b2a72b req-f2928945-0dc1-4d78-be7e-716ba47f1310 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:54.804698 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-e3f5882e-6ac0-4989-a228-29e705b2a72b req-f2928945-0dc1-4d78-be7e-716ba47f1310 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:54.817285 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-e3f5882e-6ac0-4989-a228-29e705b2a72b req-f2928945-0dc1-4d78-be7e-716ba47f1310 service nova] Creating event network-vif-deleted:fbbeac60-78b3-4a87-9aeb-fdf2a2c8957f for instance c735043f-0342-49b4-9be8-ee27f994a3ed on hv-cinder-80475 May 19 12:24:54.823545 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-e3f5882e-6ac0-4989-a228-29e705b2a72b req-f2928945-0dc1-4d78-be7e-716ba47f1310 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034287 May 19 12:24:54.824191 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 397/739] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:55.693553 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-05d7b4c7-a740-4a72-bf07-43c20312df4e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:55.694311 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-05d7b4c7-a740-4a72-bf07-43c20312df4e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:55.700955 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-05d7b4c7-a740-4a72-bf07-43c20312df4e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:55.701402 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-05d7b4c7-a740-4a72-bf07-43c20312df4e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:55.702172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-05d7b4c7-a740-4a72-bf07-43c20312df4e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:55.702628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-05d7b4c7-a740-4a72-bf07-43c20312df4e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:55.735314 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-05d7b4c7-a740-4a72-bf07-43c20312df4e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:55.735759 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-05d7b4c7-a740-4a72-bf07-43c20312df4e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:55.736228 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.objects.instance [None req-05d7b4c7-a740-4a72-bf07-43c20312df4e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lazy-loading 'fault' on Instance uuid c735043f-0342-49b4-9be8-ee27f994a3ed {{(pid=117964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:24:55.777652 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-05d7b4c7-a740-4a72-bf07-43c20312df4e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:55.786425 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-05d7b4c7-a740-4a72-bf07-43c20312df4e tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 200 len: 1312 microversion: 2.1 time: 0.097268 May 19 12:24:55.787130 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 343/740] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:55 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:56.702216 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ed7f70a6-f314-470c-b958-9173f1a87363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1609292555", "imageRef": "962252c6-9c2c-4b81-bdb7-f6d317bada3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "744c5d15-060b-4067-aa62-eecc19d1b85e"}], "security_groups": [{"name": "tempest-securitygroup--608811557"}], "key_name": "tempest-keypair-1952522990", "user_data": "}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:56.804343 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d3980824-bba0-4f6a-8d21-b34431773a67 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:56.804968 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d3980824-bba0-4f6a-8d21-b34431773a67 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: c735043f-0342-49b4-9be8-ee27f994a3ed] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:56.808684 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-ed7f70a6-f314-470c-b958-9173f1a87363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] validate_networks() for [('744c5d15-060b-4067-aa62-eecc19d1b85e', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:24:56.812020 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d3980824-bba0-4f6a-8d21-b34431773a67 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:56.812507 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d3980824-bba0-4f6a-8d21-b34431773a67 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:56.813322 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d3980824-bba0-4f6a-8d21-b34431773a67 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:56.813763 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d3980824-bba0-4f6a-8d21-b34431773a67 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:56.828359 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-d3980824-bba0-4f6a-8d21-b34431773a67 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] HTTP exception thrown: Instance c735043f-0342-49b4-9be8-ee27f994a3ed could not be found. May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d3980824-bba0-4f6a-8d21-b34431773a67 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Request method failure captured: May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed HTTP/1.1 May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjV3ba4_uVlBVIvh_bBreMWZSJM2U80SltnInJem3RpmUyDvutWhoUewS7KziAUbwrvECCf0a_6rYJitU_iO6aJz7Ech1mVe-8aUkQ9TDBlP73buFXKQkkHjg5gljrCoIVxKLRParuGEmqFHmsydgfqVGrlueaFfskHreMvIm9Etqy8 May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: b3d651a605fd4dee95797a7ec3896792 May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1292733612 May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:24:56.830044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:24:56.831617 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:24:56.831617 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1292733612 May 19 12:24:56.831617 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: b3d651a605fd4dee95797a7ec3896792 May 19 12:24:56.831617 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1292733612 May 19 12:24:56.831617 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-ServerRescueNegativeTestJSON-1292733612-project May 19 12:24:56.831617 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:24:56.831617 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:24:56.831617 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: 8e445569dc5641ed962b0ac977850a6c May 19 12:24:56.831617 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1292733612-project May 19 12:24:56.831617 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:24:56.831617 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance c735043f-0342-49b4-9be8-ee27f994a3ed could not be found. May 19 12:24:56.831617 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': 'c735043f-0342-49b4-9be8-ee27f994a3ed'} May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c735043f-0342-49b4-9be8-ee27f994a3ed could not be found. May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:24:56.832615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:24:56.833771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:24:56.833771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:24:56.833771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:24:56.833771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:24:56.833771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:24:56.833771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:24:56.833771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:24:56.833771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c735043f-0342-49b4-9be8-ee27f994a3ed could not be found. May 19 12:24:56.833771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:24:56.833771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:24:56.833771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:24:56.833771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:24:56.833771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:24:56.833771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:24:56.833771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:24:56.833771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:24:56.833771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c735043f-0342-49b4-9be8-ee27f994a3ed could not be found. May 19 12:24:56.833771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:24:56.834778 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d3980824-bba0-4f6a-8d21-b34431773a67 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Returning 404 to user: Instance c735043f-0342-49b4-9be8-ee27f994a3ed could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:24:56.834778 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d3980824-bba0-4f6a-8d21-b34431773a67 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed" status: 404 len: 111 microversion: 2.1 time: 0.031720 May 19 12:24:56.834778 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 344/741] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:56 2022] GET /compute/v2.1/servers/c735043f-0342-49b4-9be8-ee27f994a3ed => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:24:56.840570 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-86de0737-ce73-46cb-bcd0-2857516bf7ba tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:56.841046 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-86de0737-ce73-46cb-bcd0-2857516bf7ba tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:56.848715 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-86de0737-ce73-46cb-bcd0-2857516bf7ba tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:56.849162 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-86de0737-ce73-46cb-bcd0-2857516bf7ba tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:56.849959 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-86de0737-ce73-46cb-bcd0-2857516bf7ba tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:56.850397 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-86de0737-ce73-46cb-bcd0-2857516bf7ba tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:56.880665 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-86de0737-ce73-46cb-bcd0-2857516bf7ba tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Going to try to terminate instance {{(pid=117964) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:24:56.997271 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:57.031096 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:57.236086 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-ed7f70a6-f314-470c-b958-9173f1a87363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:24:57.236515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-ed7f70a6-f314-470c-b958-9173f1a87363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:24:57.236990 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-ed7f70a6-f314-470c-b958-9173f1a87363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:24:57.237402 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-ed7f70a6-f314-470c-b958-9173f1a87363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:24:57.237863 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-ed7f70a6-f314-470c-b958-9173f1a87363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:24:57.246845 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ed7f70a6-f314-470c-b958-9173f1a87363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:57.247294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ed7f70a6-f314-470c-b958-9173f1a87363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:57.248137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ed7f70a6-f314-470c-b958-9173f1a87363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:57.248566 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ed7f70a6-f314-470c-b958-9173f1a87363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:57.266250 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-ed7f70a6-f314-470c-b958-9173f1a87363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Getting quotas for project 1d2de86d602945238f5df0e2c388004f. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:24:57.270887 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-ed7f70a6-f314-470c-b958-9173f1a87363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Getting quotas for user dd39ddcf4ab045b98a737ee529a2dcce and project 1d2de86d602945238f5df0e2c388004f. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:24:57.282038 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ed7f70a6-f314-470c-b958-9173f1a87363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:24:57.284461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ed7f70a6-f314-470c-b958-9173f1a87363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962252c6-9c2c-4b81-bdb7-f6d317bada3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:24:57.314413 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-86de0737-ce73-46cb-bcd0-2857516bf7ba tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 204 len: 0 microversion: 2.1 time: 0.477490 May 19 12:24:57.317487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 345/742] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:24:56 2022] DELETE /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 12:24:57.323594 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f6cc5b50-5ed4-40fa-b721-a9458c8e188d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:57.324425 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f6cc5b50-5ed4-40fa-b721-a9458c8e188d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:57.331230 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f6cc5b50-5ed4-40fa-b721-a9458c8e188d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:57.332212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f6cc5b50-5ed4-40fa-b721-a9458c8e188d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:57.332999 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f6cc5b50-5ed4-40fa-b721-a9458c8e188d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:57.333441 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f6cc5b50-5ed4-40fa-b721-a9458c8e188d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:57.466109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ed7f70a6-f314-470c-b958-9173f1a87363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.768498 May 19 12:24:57.466764 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 398/743] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:24:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:24:57.469670 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f6cc5b50-5ed4-40fa-b721-a9458c8e188d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:57.478120 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4a3060cf-8fcf-4a14-8573-a933caa89cf7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:57.478733 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4a3060cf-8fcf-4a14-8573-a933caa89cf7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:57.478956 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f6cc5b50-5ed4-40fa-b721-a9458c8e188d tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1521 microversion: 2.1 time: 0.159362 May 19 12:24:57.479710 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 346/744] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:57 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:57.538329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4a3060cf-8fcf-4a14-8573-a933caa89cf7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:57.546027 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4a3060cf-8fcf-4a14-8573-a933caa89cf7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 200 len: 1242 microversion: 2.1 time: 0.072495 May 19 12:24:57.546591 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 399/745] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:57 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:58.497347 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d3aaa4ac-76d5-439b-b163-512466dcc904 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:58.498068 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d3aaa4ac-76d5-439b-b163-512466dcc904 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:58.505754 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d3aaa4ac-76d5-439b-b163-512466dcc904 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:58.506202 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d3aaa4ac-76d5-439b-b163-512466dcc904 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:58.506980 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d3aaa4ac-76d5-439b-b163-512466dcc904 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:58.507429 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d3aaa4ac-76d5-439b-b163-512466dcc904 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:58.563698 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-91582765-4e51-4463-b859-b5553d660e4f tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:58.564336 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-91582765-4e51-4463-b859-b5553d660e4f tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:58.572981 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-91582765-4e51-4463-b859-b5553d660e4f tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:58.573788 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-91582765-4e51-4463-b859-b5553d660e4f tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:58.574578 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-91582765-4e51-4463-b859-b5553d660e4f tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:58.575002 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-91582765-4e51-4463-b859-b5553d660e4f tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:58.651889 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-91582765-4e51-4463-b859-b5553d660e4f tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:58.655693 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:58.660508 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-91582765-4e51-4463-b859-b5553d660e4f tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 200 len: 1246 microversion: 2.1 time: 0.100185 May 19 12:24:58.664622 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 400/746] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:58 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 1246 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:58.674669 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d3aaa4ac-76d5-439b-b163-512466dcc904 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:58.682998 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d3aaa4ac-76d5-439b-b163-512466dcc904 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1521 microversion: 2.1 time: 0.189880 May 19 12:24:58.683558 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 347/747] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:58 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:59.678698 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-357ed09d-cef8-4fa8-b0a4-76ac263e0738 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:59.679320 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-357ed09d-cef8-4fa8-b0a4-76ac263e0738 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:59.686587 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-357ed09d-cef8-4fa8-b0a4-76ac263e0738 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:59.686964 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-357ed09d-cef8-4fa8-b0a4-76ac263e0738 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:59.687743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-357ed09d-cef8-4fa8-b0a4-76ac263e0738 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:59.688962 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-357ed09d-cef8-4fa8-b0a4-76ac263e0738 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:59.700221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ac7da2d8-6160-4067-a2f0-84bd5279ea12 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:59.700828 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ac7da2d8-6160-4067-a2f0-84bd5279ea12 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:59.707868 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ac7da2d8-6160-4067-a2f0-84bd5279ea12 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:59.708316 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ac7da2d8-6160-4067-a2f0-84bd5279ea12 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:59.709100 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ac7da2d8-6160-4067-a2f0-84bd5279ea12 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:59.709521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ac7da2d8-6160-4067-a2f0-84bd5279ea12 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:59.754903 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-357ed09d-cef8-4fa8-b0a4-76ac263e0738 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:59.762296 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-357ed09d-cef8-4fa8-b0a4-76ac263e0738 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 200 len: 1238 microversion: 2.1 time: 0.088668 May 19 12:24:59.762869 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 401/748] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:59 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 1238 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:59.857035 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ac7da2d8-6160-4067-a2f0-84bd5279ea12 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:59.866135 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ac7da2d8-6160-4067-a2f0-84bd5279ea12 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1521 microversion: 2.1 time: 0.169756 May 19 12:24:59.866699 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 348/749] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:24:59 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:00.723900 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-57c1850e-ab0e-4497-bd0b-d4b858baa8dc req-9ad4575b-e6c3-4dcf-ae60-28bc3bba5cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b605d4a3-bf90-430f-b2c7-d037b473d29d", "name": "network-vif-deleted", "tag": "d6fddd4a-6f06-4062-86e2-9b793547996c"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:00.733595 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-57c1850e-ab0e-4497-bd0b-d4b858baa8dc req-9ad4575b-e6c3-4dcf-ae60-28bc3bba5cc1 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:00.733829 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-57c1850e-ab0e-4497-bd0b-d4b858baa8dc req-9ad4575b-e6c3-4dcf-ae60-28bc3bba5cc1 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:00.746822 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-57c1850e-ab0e-4497-bd0b-d4b858baa8dc req-9ad4575b-e6c3-4dcf-ae60-28bc3bba5cc1 service nova] Creating event network-vif-deleted:d6fddd4a-6f06-4062-86e2-9b793547996c for instance b605d4a3-bf90-430f-b2c7-d037b473d29d on hv-cinder-80475 May 19 12:25:00.752890 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-57c1850e-ab0e-4497-bd0b-d4b858baa8dc req-9ad4575b-e6c3-4dcf-ae60-28bc3bba5cc1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033663 May 19 12:25:00.753558 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 402/750] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:00.781482 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-93843a24-191f-4a95-bb0d-ac9d03e55f5e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:00.782096 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-93843a24-191f-4a95-bb0d-ac9d03e55f5e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:00.790285 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-93843a24-191f-4a95-bb0d-ac9d03e55f5e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:00.790831 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-93843a24-191f-4a95-bb0d-ac9d03e55f5e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:00.791771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-93843a24-191f-4a95-bb0d-ac9d03e55f5e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:00.792251 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-93843a24-191f-4a95-bb0d-ac9d03e55f5e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:00.859718 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-93843a24-191f-4a95-bb0d-ac9d03e55f5e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:00.869208 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-93843a24-191f-4a95-bb0d-ac9d03e55f5e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 200 len: 1294 microversion: 2.1 time: 0.091445 May 19 12:25:00.869595 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 349/751] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:00 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:00.883572 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7510a495-ccb5-45f9-a822-5eea1daebe33 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:00.884302 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7510a495-ccb5-45f9-a822-5eea1daebe33 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:00.890814 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7510a495-ccb5-45f9-a822-5eea1daebe33 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:00.891460 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7510a495-ccb5-45f9-a822-5eea1daebe33 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:00.892260 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7510a495-ccb5-45f9-a822-5eea1daebe33 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:00.892696 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7510a495-ccb5-45f9-a822-5eea1daebe33 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:00.959028 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7510a495-ccb5-45f9-a822-5eea1daebe33 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:00.966667 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7510a495-ccb5-45f9-a822-5eea1daebe33 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1479 microversion: 2.1 time: 0.087323 May 19 12:25:00.967236 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 403/752] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:00 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1479 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:01.885652 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c07be7b5-0c05-45b7-8a13-785a12d9f804 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:01.886270 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c07be7b5-0c05-45b7-8a13-785a12d9f804 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:01.888449 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:01.893228 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c07be7b5-0c05-45b7-8a13-785a12d9f804 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:01.893819 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c07be7b5-0c05-45b7-8a13-785a12d9f804 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:01.894628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c07be7b5-0c05-45b7-8a13-785a12d9f804 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:01.895068 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c07be7b5-0c05-45b7-8a13-785a12d9f804 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:01.959465 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c07be7b5-0c05-45b7-8a13-785a12d9f804 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:01.966967 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c07be7b5-0c05-45b7-8a13-785a12d9f804 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 200 len: 1300 microversion: 2.1 time: 0.085109 May 19 12:25:01.971834 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 350/753] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:01 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:01.984316 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1fe55f88-3cf6-4d8e-ab98-f864c6f6120a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:01.984928 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1fe55f88-3cf6-4d8e-ab98-f864c6f6120a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:01.992142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1fe55f88-3cf6-4d8e-ab98-f864c6f6120a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:01.992597 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1fe55f88-3cf6-4d8e-ab98-f864c6f6120a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:01.993370 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1fe55f88-3cf6-4d8e-ab98-f864c6f6120a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:01.993806 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1fe55f88-3cf6-4d8e-ab98-f864c6f6120a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:02.025208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1fe55f88-3cf6-4d8e-ab98-f864c6f6120a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:02.025666 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1fe55f88-3cf6-4d8e-ab98-f864c6f6120a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:02.026121 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-1fe55f88-3cf6-4d8e-ab98-f864c6f6120a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lazy-loading 'fault' on Instance uuid b605d4a3-bf90-430f-b2c7-d037b473d29d {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:25:02.072057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1fe55f88-3cf6-4d8e-ab98-f864c6f6120a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e445569dc5641ed962b0ac977850a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d651a605fd4dee95797a7ec3896792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:02.080826 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1fe55f88-3cf6-4d8e-ab98-f864c6f6120a tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 200 len: 1311 microversion: 2.1 time: 0.100439 May 19 12:25:02.081695 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 404/754] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:01 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:02.989342 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6a805268-e2db-4feb-a2ac-974954dfe659 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:02.990192 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6a805268-e2db-4feb-a2ac-974954dfe659 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:02.998535 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6a805268-e2db-4feb-a2ac-974954dfe659 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:02.998998 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6a805268-e2db-4feb-a2ac-974954dfe659 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:02.999868 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6a805268-e2db-4feb-a2ac-974954dfe659 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:03.000334 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6a805268-e2db-4feb-a2ac-974954dfe659 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:03.098997 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-df6ffd15-3b40-4cf3-85f7-d275f1f63168 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:03.099608 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-df6ffd15-3b40-4cf3-85f7-d275f1f63168 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] [instance: b605d4a3-bf90-430f-b2c7-d037b473d29d] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:03.112265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df6ffd15-3b40-4cf3-85f7-d275f1f63168 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:03.112265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df6ffd15-3b40-4cf3-85f7-d275f1f63168 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:03.112265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df6ffd15-3b40-4cf3-85f7-d275f1f63168 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:03.112265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df6ffd15-3b40-4cf3-85f7-d275f1f63168 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:03.124709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-df6ffd15-3b40-4cf3-85f7-d275f1f63168 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] HTTP exception thrown: Instance b605d4a3-bf90-430f-b2c7-d037b473d29d could not be found. May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-df6ffd15-3b40-4cf3-85f7-d275f1f63168 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Request method failure captured: May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d HTTP/1.1 May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjV3ba4_uVlBVIvh_bBreMWZSJM2U80SltnInJem3RpmUyDvutWhoUewS7KziAUbwrvECCf0a_6rYJitU_iO6aJz7Ech1mVe-8aUkQ9TDBlP73buFXKQkkHjg5gljrCoIVxKLRParuGEmqFHmsydgfqVGrlueaFfskHreMvIm9Etqy8 May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: b3d651a605fd4dee95797a7ec3896792 May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1292733612 May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:25:03.126362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:25:03.127984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b3d651a605fd4dee95797a7ec3896792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:25:03.127984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1292733612 May 19 12:25:03.127984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: b3d651a605fd4dee95797a7ec3896792 May 19 12:25:03.127984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1292733612 May 19 12:25:03.127984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-ServerRescueNegativeTestJSON-1292733612-project May 19 12:25:03.127984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:25:03.127984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:25:03.127984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: 8e445569dc5641ed962b0ac977850a6c May 19 12:25:03.127984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1292733612-project May 19 12:25:03.127984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:25:03.127984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance b605d4a3-bf90-430f-b2c7-d037b473d29d could not be found. May 19 12:25:03.127984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': 'b605d4a3-bf90-430f-b2c7-d037b473d29d'} May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b605d4a3-bf90-430f-b2c7-d037b473d29d could not be found. May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:25:03.130274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:25:03.131614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:25:03.131614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:25:03.131614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:25:03.131614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:25:03.131614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:25:03.131614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:25:03.131614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:25:03.131614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b605d4a3-bf90-430f-b2c7-d037b473d29d could not be found. May 19 12:25:03.131614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:03.131614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:03.131614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:03.131614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:03.131614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:03.131614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:03.131614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:25:03.131614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:25:03.131614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b605d4a3-bf90-430f-b2c7-d037b473d29d could not be found. May 19 12:25:03.131614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:03.133131 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-df6ffd15-3b40-4cf3-85f7-d275f1f63168 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] Returning 404 to user: Instance b605d4a3-bf90-430f-b2c7-d037b473d29d could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:25:03.133131 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-df6ffd15-3b40-4cf3-85f7-d275f1f63168 tempest-ServerRescueNegativeTestJSON-1292733612 tempest-ServerRescueNegativeTestJSON-1292733612-project] 10.222.0.23 "GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d" status: 404 len: 111 microversion: 2.1 time: 0.033155 May 19 12:25:03.133131 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 405/755] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:03 2022] GET /compute/v2.1/servers/b605d4a3-bf90-430f-b2c7-d037b473d29d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:25:03.158799 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6a805268-e2db-4feb-a2ac-974954dfe659 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:03.167682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6a805268-e2db-4feb-a2ac-974954dfe659 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 200 len: 1367 microversion: 2.1 time: 0.187455 May 19 12:25:03.168383 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 351/756] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:02 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:03.364196 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-679eed1a-1c5a-4393-b6c8-4a4aa4678b27 req-4c421d05-bc19-4242-a9ca-658f2d594ccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff26d40f-6c63-40a5-af44-a128df79f323", "tag": "d05810c6-219e-400a-88f4-a1ee78e52890"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:03.373190 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-679eed1a-1c5a-4393-b6c8-4a4aa4678b27 req-4c421d05-bc19-4242-a9ca-658f2d594ccd service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:03.373633 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-679eed1a-1c5a-4393-b6c8-4a4aa4678b27 req-4c421d05-bc19-4242-a9ca-658f2d594ccd service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:03.386642 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-679eed1a-1c5a-4393-b6c8-4a4aa4678b27 req-4c421d05-bc19-4242-a9ca-658f2d594ccd service nova] Creating event network-changed:d05810c6-219e-400a-88f4-a1ee78e52890 for instance ff26d40f-6c63-40a5-af44-a128df79f323 on hv-cinder-80475 May 19 12:25:03.391684 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-679eed1a-1c5a-4393-b6c8-4a4aa4678b27 req-4c421d05-bc19-4242-a9ca-658f2d594ccd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032485 May 19 12:25:03.392418 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 406/757] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:03.653600 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-95f25146-2c4f-44b4-86cd-dc0a3807cdbd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:03.654126 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-95f25146-2c4f-44b4-86cd-dc0a3807cdbd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:03.661460 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-95f25146-2c4f-44b4-86cd-dc0a3807cdbd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:03.661906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-95f25146-2c4f-44b4-86cd-dc0a3807cdbd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:03.662679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-95f25146-2c4f-44b4-86cd-dc0a3807cdbd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:03.663113 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-95f25146-2c4f-44b4-86cd-dc0a3807cdbd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:03.687294 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.objects.instance [None req-95f25146-2c4f-44b4-86cd-dc0a3807cdbd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lazy-loading 'flavor' on Instance uuid 9431305d-b1c8-46c1-9625-0d2e0643174e {{(pid=117964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:25:04.062129 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-95f25146-2c4f-44b4-86cd-dc0a3807cdbd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "POST /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e/action" status: 202 len: 0 microversion: 2.1 time: 0.413026 May 19 12:25:04.063040 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 352/758] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 19 12:25:03 2022] POST /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:25:04.073155 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-970c0e9c-661c-4b93-8fcc-20616c3b65a9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:04.074232 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-970c0e9c-661c-4b93-8fcc-20616c3b65a9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:04.081154 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-970c0e9c-661c-4b93-8fcc-20616c3b65a9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:04.082251 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-970c0e9c-661c-4b93-8fcc-20616c3b65a9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:04.083553 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-970c0e9c-661c-4b93-8fcc-20616c3b65a9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:04.084018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-970c0e9c-661c-4b93-8fcc-20616c3b65a9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:04.185761 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-922b254d-b434-484c-8675-7d988d27a6e6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:04.186717 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-922b254d-b434-484c-8675-7d988d27a6e6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:04.194143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-922b254d-b434-484c-8675-7d988d27a6e6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:04.194682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-922b254d-b434-484c-8675-7d988d27a6e6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:04.195474 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-922b254d-b434-484c-8675-7d988d27a6e6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:04.195960 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-922b254d-b434-484c-8675-7d988d27a6e6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:04.234536 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-970c0e9c-661c-4b93-8fcc-20616c3b65a9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:04.242810 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-970c0e9c-661c-4b93-8fcc-20616c3b65a9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1569 microversion: 2.1 time: 0.174657 May 19 12:25:04.243654 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 407/759] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:04 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:04.338312 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-922b254d-b434-484c-8675-7d988d27a6e6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:04.346680 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-922b254d-b434-484c-8675-7d988d27a6e6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 200 len: 1367 microversion: 2.1 time: 0.165268 May 19 12:25:04.348049 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 353/760] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:04 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:05.261355 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a0cd11a9-5f2b-4630-ac45-d4256f9191af tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:05.261973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a0cd11a9-5f2b-4630-ac45-d4256f9191af tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:05.268566 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0cd11a9-5f2b-4630-ac45-d4256f9191af tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:05.269348 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0cd11a9-5f2b-4630-ac45-d4256f9191af tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:05.270154 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0cd11a9-5f2b-4630-ac45-d4256f9191af tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:05.270604 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0cd11a9-5f2b-4630-ac45-d4256f9191af tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:05.365237 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-058be8fc-b718-4278-995c-f71686b3e821 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:05.365975 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-058be8fc-b718-4278-995c-f71686b3e821 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:05.372918 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-058be8fc-b718-4278-995c-f71686b3e821 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:05.373373 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-058be8fc-b718-4278-995c-f71686b3e821 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:05.374157 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-058be8fc-b718-4278-995c-f71686b3e821 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:05.374641 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-058be8fc-b718-4278-995c-f71686b3e821 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:05.404765 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a0cd11a9-5f2b-4630-ac45-d4256f9191af tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:05.416710 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a0cd11a9-5f2b-4630-ac45-d4256f9191af tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1569 microversion: 2.1 time: 0.158891 May 19 12:25:05.431826 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 408/761] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:05 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:05.543014 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-058be8fc-b718-4278-995c-f71686b3e821 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:05.551582 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-058be8fc-b718-4278-995c-f71686b3e821 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 200 len: 1367 microversion: 2.1 time: 0.190773 May 19 12:25:05.552279 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 354/762] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:05 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:06.436183 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d2acba14-76c6-477f-9fd3-dbe6e4aebc87 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:06.436717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d2acba14-76c6-477f-9fd3-dbe6e4aebc87 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:06.442867 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d2acba14-76c6-477f-9fd3-dbe6e4aebc87 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:06.443320 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d2acba14-76c6-477f-9fd3-dbe6e4aebc87 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:06.444111 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d2acba14-76c6-477f-9fd3-dbe6e4aebc87 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:06.444540 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d2acba14-76c6-477f-9fd3-dbe6e4aebc87 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:06.569284 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ec52c05c-9d5a-4cd1-adc3-29611e8d7d8d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:06.570680 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ec52c05c-9d5a-4cd1-adc3-29611e8d7d8d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:06.578115 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ec52c05c-9d5a-4cd1-adc3-29611e8d7d8d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:06.578562 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ec52c05c-9d5a-4cd1-adc3-29611e8d7d8d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:06.579340 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ec52c05c-9d5a-4cd1-adc3-29611e8d7d8d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:06.579773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ec52c05c-9d5a-4cd1-adc3-29611e8d7d8d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:06.600237 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d2acba14-76c6-477f-9fd3-dbe6e4aebc87 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:06.608414 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d2acba14-76c6-477f-9fd3-dbe6e4aebc87 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1569 microversion: 2.1 time: 0.176445 May 19 12:25:06.609245 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 409/763] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:06 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:06.731394 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ec52c05c-9d5a-4cd1-adc3-29611e8d7d8d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:06.739688 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ec52c05c-9d5a-4cd1-adc3-29611e8d7d8d tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 200 len: 1367 microversion: 2.1 time: 0.174718 May 19 12:25:06.740289 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 355/764] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:06 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:07.626341 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fe3c288e-ad15-45bb-bb71-f4c5e41eb1f2 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:07.627551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-fe3c288e-ad15-45bb-bb71-f4c5e41eb1f2 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:07.635864 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:07.638691 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=12 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:07.640811 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fe3c288e-ad15-45bb-bb71-f4c5e41eb1f2 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:07.641423 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fe3c288e-ad15-45bb-bb71-f4c5e41eb1f2 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:07.642427 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fe3c288e-ad15-45bb-bb71-f4c5e41eb1f2 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:07.643716 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fe3c288e-ad15-45bb-bb71-f4c5e41eb1f2 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:07.757035 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-eb674e4d-a24c-4407-91ba-a5f32e1dae17 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:07.757831 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-eb674e4d-a24c-4407-91ba-a5f32e1dae17 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:07.766366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-eb674e4d-a24c-4407-91ba-a5f32e1dae17 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:07.767138 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-eb674e4d-a24c-4407-91ba-a5f32e1dae17 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:07.767988 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-eb674e4d-a24c-4407-91ba-a5f32e1dae17 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:07.768577 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-eb674e4d-a24c-4407-91ba-a5f32e1dae17 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:07.969969 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fe3c288e-ad15-45bb-bb71-f4c5e41eb1f2 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:07.977875 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fe3c288e-ad15-45bb-bb71-f4c5e41eb1f2 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1569 microversion: 2.1 time: 0.355510 May 19 12:25:07.978460 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 410/765] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:07 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1569 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:08.056179 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-eb674e4d-a24c-4407-91ba-a5f32e1dae17 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:08.064232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-eb674e4d-a24c-4407-91ba-a5f32e1dae17 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 200 len: 1367 microversion: 2.1 time: 0.311909 May 19 12:25:08.064928 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 356/766] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:07 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:08.997440 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b02b914a-e725-47a2-865d-ee902e7f415b tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:08.998073 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b02b914a-e725-47a2-865d-ee902e7f415b tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:09.005802 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b02b914a-e725-47a2-865d-ee902e7f415b tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:09.006257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b02b914a-e725-47a2-865d-ee902e7f415b tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:09.007288 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b02b914a-e725-47a2-865d-ee902e7f415b tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:09.007812 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b02b914a-e725-47a2-865d-ee902e7f415b tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:09.082525 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a072a951-daf4-4a6b-b777-9439d4e37060 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:09.083142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a072a951-daf4-4a6b-b777-9439d4e37060 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:09.089869 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a072a951-daf4-4a6b-b777-9439d4e37060 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:09.090642 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a072a951-daf4-4a6b-b777-9439d4e37060 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:09.091067 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a072a951-daf4-4a6b-b777-9439d4e37060 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:09.091513 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a072a951-daf4-4a6b-b777-9439d4e37060 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:09.184273 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b02b914a-e725-47a2-865d-ee902e7f415b tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:09.192594 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b02b914a-e725-47a2-865d-ee902e7f415b tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1569 microversion: 2.1 time: 0.199225 May 19 12:25:09.193170 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 411/767] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:08 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:09.248270 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a072a951-daf4-4a6b-b777-9439d4e37060 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:09.255886 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a072a951-daf4-4a6b-b777-9439d4e37060 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 200 len: 1367 microversion: 2.1 time: 0.177367 May 19 12:25:09.256461 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 357/768] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:09 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:10.210531 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ab399b48-4370-49a6-a03e-d15404e7054c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:10.211166 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ab399b48-4370-49a6-a03e-d15404e7054c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:10.218135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ab399b48-4370-49a6-a03e-d15404e7054c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:10.218613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ab399b48-4370-49a6-a03e-d15404e7054c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:10.219285 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ab399b48-4370-49a6-a03e-d15404e7054c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:10.219717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ab399b48-4370-49a6-a03e-d15404e7054c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:10.276328 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6b6a0fac-e4af-4f17-8416-0b3d77a91b28 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:10.277877 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6b6a0fac-e4af-4f17-8416-0b3d77a91b28 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:10.289940 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6b6a0fac-e4af-4f17-8416-0b3d77a91b28 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:10.290332 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6b6a0fac-e4af-4f17-8416-0b3d77a91b28 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:10.293881 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6b6a0fac-e4af-4f17-8416-0b3d77a91b28 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:10.294337 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6b6a0fac-e4af-4f17-8416-0b3d77a91b28 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:10.400841 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ab399b48-4370-49a6-a03e-d15404e7054c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:10.410141 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ab399b48-4370-49a6-a03e-d15404e7054c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1569 microversion: 2.1 time: 0.204049 May 19 12:25:10.410821 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 412/769] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:10 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:10.538205 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-15047d93-d90b-4858-9fb4-016a0fabc1bb tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Action: 'create', calling method: .version_select at 0x7f3ba2a2f700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1341134923"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:10.620075 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6b6a0fac-e4af-4f17-8416-0b3d77a91b28 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:10.627687 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6b6a0fac-e4af-4f17-8416-0b3d77a91b28 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 200 len: 1367 microversion: 2.1 time: 0.358781 May 19 12:25:10.629054 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 358/770] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:10 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:10.633638 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-50a5057b-cb7c-41c6-8ff4-2cfd980fd5f8 req-32b610a6-92cf-4f4b-aa79-c576a8817f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff26d40f-6c63-40a5-af44-a128df79f323", "name": "network-vif-plugged", "status": "completed", "tag": "d05810c6-219e-400a-88f4-a1ee78e52890"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:10.642455 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-50a5057b-cb7c-41c6-8ff4-2cfd980fd5f8 req-32b610a6-92cf-4f4b-aa79-c576a8817f95 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:10.642911 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-50a5057b-cb7c-41c6-8ff4-2cfd980fd5f8 req-32b610a6-92cf-4f4b-aa79-c576a8817f95 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:10.654216 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-50a5057b-cb7c-41c6-8ff4-2cfd980fd5f8 req-32b610a6-92cf-4f4b-aa79-c576a8817f95 service nova] Creating event network-vif-plugged:d05810c6-219e-400a-88f4-a1ee78e52890 for instance ff26d40f-6c63-40a5-af44-a128df79f323 on hv-cinder-80475 May 19 12:25:10.659568 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-50a5057b-cb7c-41c6-8ff4-2cfd980fd5f8 req-32b610a6-92cf-4f4b-aa79-c576a8817f95 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029101 May 19 12:25:10.660113 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 359/771] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:11.307696 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-15047d93-d90b-4858-9fb4-016a0fabc1bb tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.895367 May 19 12:25:11.308403 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 413/772] 10.222.0.23 () {60 vars in 1154 bytes} [Thu May 19 12:25:10 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 897 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 19 12:25:11.320063 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-018c5710-24e1-42cb-ac2e-0ccc2d9c6987 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Calling method '.version_select at 0x7f3ba29821f0>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:11.370873 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-018c5710-24e1-42cb-ac2e-0ccc2d9c6987 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2527c014-81ce-4c94-8e86-8a5495963ef6" status: 200 len: 345 microversion: 2.1 time: 0.055222 May 19 12:25:11.371461 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 360/773] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 19 12:25:11 2022] GET /compute/v2.1/os-volumes/2527c014-81ce-4c94-8e86-8a5495963ef6 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:11.428277 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-41442bc8-6917-48fe-a8f7-85b1f48d11cd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:11.428924 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-41442bc8-6917-48fe-a8f7-85b1f48d11cd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:11.435642 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-41442bc8-6917-48fe-a8f7-85b1f48d11cd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:11.436119 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-41442bc8-6917-48fe-a8f7-85b1f48d11cd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:11.436881 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-41442bc8-6917-48fe-a8f7-85b1f48d11cd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:11.437314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-41442bc8-6917-48fe-a8f7-85b1f48d11cd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:11.577433 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-41442bc8-6917-48fe-a8f7-85b1f48d11cd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:11.585781 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-41442bc8-6917-48fe-a8f7-85b1f48d11cd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1569 microversion: 2.1 time: 0.162121 May 19 12:25:11.586362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 414/774] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:11 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:11.645937 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-75015b16-3ed7-4b37-ad47-35456bd650e6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:11.646594 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-75015b16-3ed7-4b37-ad47-35456bd650e6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:11.653011 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-75015b16-3ed7-4b37-ad47-35456bd650e6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:11.653462 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-75015b16-3ed7-4b37-ad47-35456bd650e6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:11.654227 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-75015b16-3ed7-4b37-ad47-35456bd650e6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:11.654668 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-75015b16-3ed7-4b37-ad47-35456bd650e6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:11.785075 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-75015b16-3ed7-4b37-ad47-35456bd650e6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:11.792666 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-75015b16-3ed7-4b37-ad47-35456bd650e6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 200 len: 1367 microversion: 2.1 time: 0.151101 May 19 12:25:11.793226 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 361/775] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:11 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:12.383279 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ea99d6e3-5be1-4f45-b996-a79f5ebc24db tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Calling method '.version_select at 0x7f3ba29fe940>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:12.431111 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ea99d6e3-5be1-4f45-b996-a79f5ebc24db tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2527c014-81ce-4c94-8e86-8a5495963ef6" status: 200 len: 345 microversion: 2.1 time: 0.051846 May 19 12:25:12.431681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 415/776] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 19 12:25:12 2022] GET /compute/v2.1/os-volumes/2527c014-81ce-4c94-8e86-8a5495963ef6 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:12.603577 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d1ee86c7-b318-4e08-9dd8-faa0be5a45a0 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:12.604414 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d1ee86c7-b318-4e08-9dd8-faa0be5a45a0 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:12.611555 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d1ee86c7-b318-4e08-9dd8-faa0be5a45a0 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:12.612040 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d1ee86c7-b318-4e08-9dd8-faa0be5a45a0 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:12.613421 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d1ee86c7-b318-4e08-9dd8-faa0be5a45a0 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:12.613977 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d1ee86c7-b318-4e08-9dd8-faa0be5a45a0 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:12.618005 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:12.750836 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d1ee86c7-b318-4e08-9dd8-faa0be5a45a0 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:12.758309 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d1ee86c7-b318-4e08-9dd8-faa0be5a45a0 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1569 microversion: 2.1 time: 0.158756 May 19 12:25:12.758866 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 362/777] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:12 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:12.812548 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-01e1a14d-a6e1-413f-a813-76ad49ff523a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:12.813153 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-01e1a14d-a6e1-413f-a813-76ad49ff523a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:12.819721 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-01e1a14d-a6e1-413f-a813-76ad49ff523a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:12.820909 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-01e1a14d-a6e1-413f-a813-76ad49ff523a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:12.821777 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-01e1a14d-a6e1-413f-a813-76ad49ff523a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:12.822309 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-01e1a14d-a6e1-413f-a813-76ad49ff523a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:12.956971 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-01e1a14d-a6e1-413f-a813-76ad49ff523a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:12.964576 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-01e1a14d-a6e1-413f-a813-76ad49ff523a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 200 len: 1367 microversion: 2.1 time: 0.155959 May 19 12:25:12.965144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 416/778] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:12 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:13.443624 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-aeb461f9-7b28-487e-a8f8-c403c2c50065 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Calling method '.version_select at 0x7f3ba29b8700>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:13.493009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-aeb461f9-7b28-487e-a8f8-c403c2c50065 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2527c014-81ce-4c94-8e86-8a5495963ef6" status: 200 len: 346 microversion: 2.1 time: 0.053793 May 19 12:25:13.499062 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 363/779] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 19 12:25:13 2022] GET /compute/v2.1/os-volumes/2527c014-81ce-4c94-8e86-8a5495963ef6 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:13.504915 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-96e8fa4c-a3eb-4d36-a593-c119faf28a77 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Action: 'create', calling method: .version_select at 0x7f3ba29fe4c0>, body: {"snapshot": {"volume_id": "2527c014-81ce-4c94-8e86-8a5495963ef6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-10077294"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:13.776713 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d47637a6-18d7-4c53-92ba-812906d9c7f6 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:13.777273 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d47637a6-18d7-4c53-92ba-812906d9c7f6 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:13.783755 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d47637a6-18d7-4c53-92ba-812906d9c7f6 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:13.788456 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d47637a6-18d7-4c53-92ba-812906d9c7f6 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:13.788456 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d47637a6-18d7-4c53-92ba-812906d9c7f6 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:13.788456 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d47637a6-18d7-4c53-92ba-812906d9c7f6 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:13.924185 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d47637a6-18d7-4c53-92ba-812906d9c7f6 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:13.934389 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d47637a6-18d7-4c53-92ba-812906d9c7f6 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1569 microversion: 2.1 time: 0.162302 May 19 12:25:13.934961 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 364/780] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:13 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:13.982403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d20c12a6-e747-448c-8b23-b78b24f6ed4a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:13.983016 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d20c12a6-e747-448c-8b23-b78b24f6ed4a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:13.990017 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d20c12a6-e747-448c-8b23-b78b24f6ed4a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:13.990492 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d20c12a6-e747-448c-8b23-b78b24f6ed4a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:13.991260 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d20c12a6-e747-448c-8b23-b78b24f6ed4a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:13.991726 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d20c12a6-e747-448c-8b23-b78b24f6ed4a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:14.123929 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d20c12a6-e747-448c-8b23-b78b24f6ed4a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:14.132353 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d20c12a6-e747-448c-8b23-b78b24f6ed4a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 200 len: 1556 microversion: 2.1 time: 0.153874 May 19 12:25:14.132917 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 365/781] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:13 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:14.148031 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ad39d10e-c28a-4619-8d52-79d46530c547 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:14.148518 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ad39d10e-c28a-4619-8d52-79d46530c547 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:14.154582 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ad39d10e-c28a-4619-8d52-79d46530c547 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:14.155029 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ad39d10e-c28a-4619-8d52-79d46530c547 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:14.155825 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ad39d10e-c28a-4619-8d52-79d46530c547 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:14.156244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ad39d10e-c28a-4619-8d52-79d46530c547 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:14.165212 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-96e8fa4c-a3eb-4d36-a593-c119faf28a77 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.664283 May 19 12:25:14.166041 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 417/782] 10.222.0.23 () {60 vars in 1161 bytes} [Thu May 19 12:25:13 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:25:14.176520 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4ee3bd88-9075-4cf0-a88d-226272a0dc12 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Calling method '.version_select at 0x7f3ba2ab5dc0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:14.208042 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4ee3bd88-9075-4cf0-a88d-226272a0dc12 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381" status: 200 len: 285 microversion: 2.1 time: 0.036175 May 19 12:25:14.208624 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 418/783] 10.222.0.23 () {58 vars in 1250 bytes} [Thu May 19 12:25:14 2022] GET /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:25:14.218018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-50339e7f-e160-46db-86b7-94214b04ea4d tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Calling method '.version_select at 0x7f3ba2ab5ca0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:14.244264 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ad39d10e-c28a-4619-8d52-79d46530c547 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099681 May 19 12:25:14.245174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 366/784] 10.222.0.23 () {58 vars in 1274 bytes} [Thu May 19 12:25:14 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:25:14.250202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-50339e7f-e160-46db-86b7-94214b04ea4d tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.035758 May 19 12:25:14.250818 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 419/785] 10.222.0.23 () {58 vars in 1139 bytes} [Thu May 19 12:25:14 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:25:14.261759 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c2725336-6610-4ae8-97fc-0ec5cd01297f tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Calling method '.version_select at 0x7f3ba296d310>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:14.292776 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c2725336-6610-4ae8-97fc-0ec5cd01297f tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381" status: 200 len: 285 microversion: 2.1 time: 0.034788 May 19 12:25:14.293362 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 367/786] 10.222.0.23 () {58 vars in 1250 bytes} [Thu May 19 12:25:14 2022] GET /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381 => generated 285 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:14.952924 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d79c0e62-5918-4af1-a9d4-123618f39d1a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:14.953570 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d79c0e62-5918-4af1-a9d4-123618f39d1a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:14.960675 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d79c0e62-5918-4af1-a9d4-123618f39d1a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:14.961127 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d79c0e62-5918-4af1-a9d4-123618f39d1a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:14.961899 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d79c0e62-5918-4af1-a9d4-123618f39d1a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:14.962340 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d79c0e62-5918-4af1-a9d4-123618f39d1a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:15.105171 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d79c0e62-5918-4af1-a9d4-123618f39d1a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:15.113213 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d79c0e62-5918-4af1-a9d4-123618f39d1a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1569 microversion: 2.1 time: 0.164800 May 19 12:25:15.113775 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 420/787] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:14 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:15.305888 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-3ce750de-2a35-46c9-8278-2a128c7667d6 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Calling method '.version_select at 0x7f3ba29f9310>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:15.336370 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-3ce750de-2a35-46c9-8278-2a128c7667d6 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381" status: 200 len: 285 microversion: 2.1 time: 0.035015 May 19 12:25:15.337101 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 368/788] 10.222.0.23 () {58 vars in 1250 bytes} [Thu May 19 12:25:15 2022] GET /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:15.448651 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-23de576c-d5e5-4fac-b932-220241a76045 req-4f1127ba-456b-4ee1-bcc7-a73a9197c7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff26d40f-6c63-40a5-af44-a128df79f323", "tag": "d05810c6-219e-400a-88f4-a1ee78e52890"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:15.457115 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-23de576c-d5e5-4fac-b932-220241a76045 req-4f1127ba-456b-4ee1-bcc7-a73a9197c7d2 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:15.457633 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-23de576c-d5e5-4fac-b932-220241a76045 req-4f1127ba-456b-4ee1-bcc7-a73a9197c7d2 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:15.470683 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-23de576c-d5e5-4fac-b932-220241a76045 req-4f1127ba-456b-4ee1-bcc7-a73a9197c7d2 service nova] Creating event network-changed:d05810c6-219e-400a-88f4-a1ee78e52890 for instance ff26d40f-6c63-40a5-af44-a128df79f323 on hv-cinder-80475 May 19 12:25:15.476341 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-23de576c-d5e5-4fac-b932-220241a76045 req-4f1127ba-456b-4ee1-bcc7-a73a9197c7d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031219 May 19 12:25:15.476960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 421/789] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:16.130856 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5e18621e-d13a-4660-a8d0-49575611dab7 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:16.131386 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5e18621e-d13a-4660-a8d0-49575611dab7 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:16.140279 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5e18621e-d13a-4660-a8d0-49575611dab7 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:16.140726 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5e18621e-d13a-4660-a8d0-49575611dab7 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:16.141505 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5e18621e-d13a-4660-a8d0-49575611dab7 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:16.141935 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5e18621e-d13a-4660-a8d0-49575611dab7 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:16.282883 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5e18621e-d13a-4660-a8d0-49575611dab7 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:16.292048 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5e18621e-d13a-4660-a8d0-49575611dab7 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1569 microversion: 2.1 time: 0.165507 May 19 12:25:16.292783 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 369/790] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:16 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:16.349490 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4accdddf-024e-4aa5-8b17-c619c7cc7e5e tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Calling method '.version_select at 0x7f3ba297f670>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:16.381790 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4accdddf-024e-4aa5-8b17-c619c7cc7e5e tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381" status: 200 len: 285 microversion: 2.1 time: 0.036884 May 19 12:25:16.382425 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 422/791] 10.222.0.23 () {58 vars in 1250 bytes} [Thu May 19 12:25:16 2022] GET /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381 => generated 285 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:17.309911 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0d6974ea-56a0-4c6d-8366-1020178d8b8c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:17.310527 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0d6974ea-56a0-4c6d-8366-1020178d8b8c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:17.317431 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0d6974ea-56a0-4c6d-8366-1020178d8b8c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:17.317884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0d6974ea-56a0-4c6d-8366-1020178d8b8c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:17.318657 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0d6974ea-56a0-4c6d-8366-1020178d8b8c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:17.319102 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0d6974ea-56a0-4c6d-8366-1020178d8b8c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:17.394376 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4c785799-9b43-4da9-b619-c951098f92d1 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Calling method '.version_select at 0x7f3ba2a24c10>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:17.425782 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4c785799-9b43-4da9-b619-c951098f92d1 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381" status: 200 len: 285 microversion: 2.1 time: 0.034424 May 19 12:25:17.426460 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 423/792] 10.222.0.23 () {58 vars in 1250 bytes} [Thu May 19 12:25:17 2022] GET /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:25:17.457247 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-0d6974ea-56a0-4c6d-8366-1020178d8b8c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:17.464819 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0d6974ea-56a0-4c6d-8366-1020178d8b8c tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1569 microversion: 2.1 time: 0.158834 May 19 12:25:17.465385 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 370/793] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:17 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:18.438377 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a91779b3-bc76-40e3-bde7-0916d4cdfbe2 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Calling method '.version_select at 0x7f3ba29fe820>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:18.467531 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a91779b3-bc76-40e3-bde7-0916d4cdfbe2 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381" status: 200 len: 285 microversion: 2.1 time: 0.033604 May 19 12:25:18.468184 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 424/794] 10.222.0.23 () {58 vars in 1250 bytes} [Thu May 19 12:25:18 2022] GET /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:18.482184 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-66a5687a-8bd8-4bc7-8547-80257e4b5cb8 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:18.482787 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-66a5687a-8bd8-4bc7-8547-80257e4b5cb8 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:18.490145 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-66a5687a-8bd8-4bc7-8547-80257e4b5cb8 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:18.490584 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-66a5687a-8bd8-4bc7-8547-80257e4b5cb8 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:18.491370 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-66a5687a-8bd8-4bc7-8547-80257e4b5cb8 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:18.491828 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-66a5687a-8bd8-4bc7-8547-80257e4b5cb8 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:18.621901 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-66a5687a-8bd8-4bc7-8547-80257e4b5cb8 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:18.629512 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-66a5687a-8bd8-4bc7-8547-80257e4b5cb8 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1569 microversion: 2.1 time: 0.151113 May 19 12:25:18.630069 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 371/795] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:18 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:19.016442 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0500cf0c-41fa-40cf-9a0a-a4e111781cf3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:19.016442 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0500cf0c-41fa-40cf-9a0a-a4e111781cf3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:19.024513 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0500cf0c-41fa-40cf-9a0a-a4e111781cf3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:19.025068 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0500cf0c-41fa-40cf-9a0a-a4e111781cf3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:19.025943 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0500cf0c-41fa-40cf-9a0a-a4e111781cf3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:19.026435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0500cf0c-41fa-40cf-9a0a-a4e111781cf3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:19.057549 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0500cf0c-41fa-40cf-9a0a-a4e111781cf3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/os-volume_attachments/80fe4a37-3bb1-490c-ba21-8ab8ff831f66" status: 200 len: 194 microversion: 2.20 time: 0.185755 May 19 12:25:19.058230 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 425/796] 10.222.0.23 () {60 vars in 1453 bytes} [Thu May 19 12:25:18 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/os-volume_attachments/80fe4a37-3bb1-490c-ba21-8ab8ff831f66 => generated 194 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:25:19.135648 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-96b5e5ae-a550-4707-baee-cefa3ad5cd67 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:19.136181 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-96b5e5ae-a550-4707-baee-cefa3ad5cd67 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:19.143051 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-96b5e5ae-a550-4707-baee-cefa3ad5cd67 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:19.150394 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-96b5e5ae-a550-4707-baee-cefa3ad5cd67 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:19.150394 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-96b5e5ae-a550-4707-baee-cefa3ad5cd67 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:19.150394 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-96b5e5ae-a550-4707-baee-cefa3ad5cd67 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:19.233055 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.objects.instance [None req-96b5e5ae-a550-4707-baee-cefa3ad5cd67 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lazy-loading 'services' on Instance uuid aedab7fb-ae90-48e1-8745-626d60c88a1a {{(pid=117964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:25:19.479456 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0434c418-e58c-42d1-b289-863d396772f2 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Calling method '.version_select at 0x7f3ba2a128b0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:19.510199 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0434c418-e58c-42d1-b289-863d396772f2 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381" status: 200 len: 286 microversion: 2.1 time: 0.034516 May 19 12:25:19.510767 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 426/797] 10.222.0.23 () {58 vars in 1250 bytes} [Thu May 19 12:25:19 2022] GET /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:25:19.521975 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-dd0de080-b2a9-4b57-a377-c518d5979175 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Calling method '.version_select at 0x7f3ba2a87430>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:19.545079 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-96b5e5ae-a550-4707-baee-cefa3ad5cd67 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/os-volume_attachments/80fe4a37-3bb1-490c-ba21-8ab8ff831f66" status: 202 len: 0 microversion: 2.20 time: 0.413295 May 19 12:25:19.552200 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 372/798] 10.222.0.23 () {60 vars in 1456 bytes} [Thu May 19 12:25:19 2022] DELETE /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/os-volume_attachments/80fe4a37-3bb1-490c-ba21-8ab8ff831f66 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 12:25:19.559805 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-63dd748e-7842-4c77-89aa-a2da44828e48 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:19.560842 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-63dd748e-7842-4c77-89aa-a2da44828e48 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:19.568550 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-63dd748e-7842-4c77-89aa-a2da44828e48 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:19.569003 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-63dd748e-7842-4c77-89aa-a2da44828e48 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:19.569781 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-63dd748e-7842-4c77-89aa-a2da44828e48 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:19.570221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-63dd748e-7842-4c77-89aa-a2da44828e48 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:19.615334 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-63dd748e-7842-4c77-89aa-a2da44828e48 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046811 May 19 12:25:19.615334 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 373/799] 10.222.0.23 () {60 vars in 1342 bytes} [Thu May 19 12:25:19 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:25:19.646611 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5d0c01e5-d568-47e6-a264-bf04bf26315d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:19.649509 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5d0c01e5-d568-47e6-a264-bf04bf26315d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:19.653321 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5d0c01e5-d568-47e6-a264-bf04bf26315d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:19.653796 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5d0c01e5-d568-47e6-a264-bf04bf26315d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:19.654642 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5d0c01e5-d568-47e6-a264-bf04bf26315d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:19.655074 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5d0c01e5-d568-47e6-a264-bf04bf26315d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:19.700802 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-dd0de080-b2a9-4b57-a377-c518d5979175 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381" status: 202 len: 0 microversion: 2.1 time: 0.183575 May 19 12:25:19.701400 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 427/800] 10.222.0.23 () {58 vars in 1253 bytes} [Thu May 19 12:25:19 2022] DELETE /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 12:25:19.711292 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-39132116-163b-403a-bfc3-b0ffe264bf37 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Calling method '.version_select at 0x7f3ba29d2ca0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:19.759642 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-39132116-163b-403a-bfc3-b0ffe264bf37 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381" status: 200 len: 285 microversion: 2.1 time: 0.036134 May 19 12:25:19.759642 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 428/801] 10.222.0.23 () {58 vars in 1250 bytes} [Thu May 19 12:25:19 2022] GET /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381 => generated 285 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:19.790951 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5d0c01e5-d568-47e6-a264-bf04bf26315d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:19.798813 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5d0c01e5-d568-47e6-a264-bf04bf26315d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1569 microversion: 2.1 time: 0.156852 May 19 12:25:19.800550 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 374/802] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:19 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:20.625572 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1468513c-e7e8-4eef-94d4-3bc662dd5e24 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:20.626544 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1468513c-e7e8-4eef-94d4-3bc662dd5e24 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:20.632966 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1468513c-e7e8-4eef-94d4-3bc662dd5e24 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:20.633410 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1468513c-e7e8-4eef-94d4-3bc662dd5e24 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:20.634163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1468513c-e7e8-4eef-94d4-3bc662dd5e24 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:20.634592 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1468513c-e7e8-4eef-94d4-3bc662dd5e24 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:20.663912 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1468513c-e7e8-4eef-94d4-3bc662dd5e24 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042836 May 19 12:25:20.664530 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 429/803] 10.222.0.23 () {60 vars in 1342 bytes} [Thu May 19 12:25:20 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 12:25:20.754515 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-1ce912da-64b0-43af-acbc-58e9bda7e6f1 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Calling method '.version_select at 0x7f3ba2adae50>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:20.780334 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-1ce912da-64b0-43af-acbc-58e9bda7e6f1 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] HTTP exception thrown: Snapshot 9bcae704-08fb-4cbe-8818-b40a3b940381 could not be found. May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-1ce912da-64b0-43af-acbc-58e9bda7e6f1 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Request method failure captured: May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: GET /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381 HTTP/1.1 May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjcmvDwAoDFmBwVv2N7_YxGxtgGjuIVYDwC7_xOxsyyHOJK2fukHSN7q6r1jCC5N-NFPvw84f_QwrysaFSvvMKD3hdiPrziHe_ypJdW1UYu84gy1sJuS9aCR6lAuwc1l7V3znwLeJH4usNRnO3SE-Qb2PNuYCHo2nLrkwR6HMxsSEwM May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 54a9930dd8cf4efdbd257f9df7aecbce May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-486163017 May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:25:20.791952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:25:20.801089 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_54a9930dd8cf4efdbd257f9df7aecbce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/54a9930dd8cf4efdbd257f9df7aecbce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/54a9930dd8cf4efdbd257f9df7aecbce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/54a9930dd8cf4efdbd257f9df7aecbce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:25:20.801089 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-VolumesSnapshotsTestJSON-486163017 May 19 12:25:20.801089 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 54a9930dd8cf4efdbd257f9df7aecbce May 19 12:25:20.801089 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-486163017 May 19 12:25:20.801089 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-VolumesSnapshotsTestJSON-486163017-project May 19 12:25:20.801089 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:25:20.801089 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:25:20.801089 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: d8e636431a2e46c7aed3776e50b04523 May 19 12:25:20.801089 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-VolumesSnapshotsTestJSON-486163017-project May 19 12:25:20.801089 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: May 19 12:25:20.801089 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Snapshot 9bcae704-08fb-4cbe-8818-b40a3b940381 could not be found. May 19 12:25:20.801089 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': '9bcae704-08fb-4cbe-8818-b40a3b940381'} May 19 12:25:20.801089 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:25:20.802176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:20.802176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 12:25:20.802176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 12:25:20.802176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 12:25:20.802176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 12:25:20.802176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 12:25:20.802176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 12:25:20.802176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:25:20.802176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:25:20.802176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:25:20.802176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:25:20.802176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:25:20.802176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:25:20.802176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:25:20.802176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:25:20.802176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9bcae704-08fb-4cbe-8818-b40a3b940381 could not be found. (HTTP 404) (Request-ID: req-89dc95ec-d93a-4f66-828d-f273033842e6) May 19 12:25:20.802176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:25:20.802176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:20.803520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:25:20.803520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:20.803520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 19 12:25:20.803520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 19 12:25:20.803520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 12:25:20.803520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 12:25:20.803520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 19 12:25:20.803520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 19 12:25:20.803520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 12:25:20.803520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 12:25:20.803520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 12:25:20.803520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 12:25:20.803520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 12:25:20.803520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 12:25:20.803520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 12:25:20.803520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 12:25:20.803520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:25:20.803520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:25:20.803520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9bcae704-08fb-4cbe-8818-b40a3b940381 could not be found. May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 19 12:25:20.804921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:25:20.806453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9bcae704-08fb-4cbe-8818-b40a3b940381 could not be found. May 19 12:25:20.806453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:25:20.806453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:20.806453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:25:20.806453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:20.806453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:20.806453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:20.806453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:25:20.806453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:25:20.806453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9bcae704-08fb-4cbe-8818-b40a3b940381 could not be found. May 19 12:25:20.806453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:25:20.806453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-1ce912da-64b0-43af-acbc-58e9bda7e6f1 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Returning 404 to user: Snapshot 9bcae704-08fb-4cbe-8818-b40a3b940381 could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:25:20.806453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-1ce912da-64b0-43af-acbc-58e9bda7e6f1 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381" status: 404 len: 111 microversion: 2.1 time: 0.043325 May 19 12:25:20.806453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 375/804] 10.222.0.23 () {58 vars in 1250 bytes} [Thu May 19 12:25:20 2022] GET /compute/v2.1/os-snapshots/9bcae704-08fb-4cbe-8818-b40a3b940381 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:25:20.811859 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e9a918d0-f886-4869-8313-db95d2471e6f tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Calling method '.version_select at 0x7f3ba2991b80>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:20.817084 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ce4a9f22-3d9d-43f7-9cd7-291c1f489e42 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:20.817848 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ce4a9f22-3d9d-43f7-9cd7-291c1f489e42 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:20.825902 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ce4a9f22-3d9d-43f7-9cd7-291c1f489e42 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:20.826316 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ce4a9f22-3d9d-43f7-9cd7-291c1f489e42 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:20.827136 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ce4a9f22-3d9d-43f7-9cd7-291c1f489e42 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:20.827579 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ce4a9f22-3d9d-43f7-9cd7-291c1f489e42 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:20.965534 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ce4a9f22-3d9d-43f7-9cd7-291c1f489e42 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:20.973748 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ce4a9f22-3d9d-43f7-9cd7-291c1f489e42 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1569 microversion: 2.1 time: 0.160979 May 19 12:25:20.974316 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 376/805] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:20 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:21.118349 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e9a918d0-f886-4869-8313-db95d2471e6f tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/2527c014-81ce-4c94-8e86-8a5495963ef6" status: 202 len: 0 microversion: 2.1 time: 0.319782 May 19 12:25:21.118919 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 430/806] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 19 12:25:20 2022] DELETE /compute/v2.1/os-volumes/2527c014-81ce-4c94-8e86-8a5495963ef6 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:25:21.127065 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-bd53c442-9d8c-4adf-ad0b-682855eacef4 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Calling method '.version_select at 0x7f3b9d8544c0>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:21.173759 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-bd53c442-9d8c-4adf-ad0b-682855eacef4 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2527c014-81ce-4c94-8e86-8a5495963ef6" status: 200 len: 345 microversion: 2.1 time: 0.050512 May 19 12:25:21.175636 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 377/807] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 19 12:25:21 2022] GET /compute/v2.1/os-volumes/2527c014-81ce-4c94-8e86-8a5495963ef6 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:25:21.676765 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-36612ead-65f5-4da1-96db-d47ba1baf8e3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:21.677780 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-36612ead-65f5-4da1-96db-d47ba1baf8e3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:21.684808 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-36612ead-65f5-4da1-96db-d47ba1baf8e3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:21.685262 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-36612ead-65f5-4da1-96db-d47ba1baf8e3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:21.686059 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-36612ead-65f5-4da1-96db-d47ba1baf8e3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:21.686496 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-36612ead-65f5-4da1-96db-d47ba1baf8e3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:21.713255 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:21.717802 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-36612ead-65f5-4da1-96db-d47ba1baf8e3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045610 May 19 12:25:21.718393 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 431/808] 10.222.0.23 () {60 vars in 1342 bytes} [Thu May 19 12:25:21 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:25:21.992314 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-feae9c9d-ea0e-4512-865e-24ccf43f4a0a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:21.992930 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-feae9c9d-ea0e-4512-865e-24ccf43f4a0a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:21.999134 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-feae9c9d-ea0e-4512-865e-24ccf43f4a0a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:21.999591 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-feae9c9d-ea0e-4512-865e-24ccf43f4a0a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:22.000392 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-feae9c9d-ea0e-4512-865e-24ccf43f4a0a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:22.000831 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-feae9c9d-ea0e-4512-865e-24ccf43f4a0a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:22.139292 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-feae9c9d-ea0e-4512-865e-24ccf43f4a0a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:22.147557 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-feae9c9d-ea0e-4512-865e-24ccf43f4a0a tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1569 microversion: 2.1 time: 0.160778 May 19 12:25:22.148158 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 378/809] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:21 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:22.186867 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-78fdcb07-ea38-4ab7-8fa0-a2d8e04b3423 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Calling method '.version_select at 0x7f3ba2991790>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:22.216500 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-78fdcb07-ea38-4ab7-8fa0-a2d8e04b3423 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] HTTP exception thrown: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-78fdcb07-ea38-4ab7-8fa0-a2d8e04b3423 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Request method failure captured: May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/os-volumes/2527c014-81ce-4c94-8e86-8a5495963ef6 HTTP/1.1 May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjcmvDwAoDFmBwVv2N7_YxGxtgGjuIVYDwC7_xOxsyyHOJK2fukHSN7q6r1jCC5N-NFPvw84f_QwrysaFSvvMKD3hdiPrziHe_ypJdW1UYu84gy1sJuS9aCR6lAuwc1l7V3znwLeJH4usNRnO3SE-Qb2PNuYCHo2nLrkwR6HMxsSEwM May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 54a9930dd8cf4efdbd257f9df7aecbce May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-486163017 May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:25:22.218580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:25:22.220094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_54a9930dd8cf4efdbd257f9df7aecbce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/54a9930dd8cf4efdbd257f9df7aecbce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/54a9930dd8cf4efdbd257f9df7aecbce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/54a9930dd8cf4efdbd257f9df7aecbce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:25:22.220094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-VolumesSnapshotsTestJSON-486163017 May 19 12:25:22.220094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 54a9930dd8cf4efdbd257f9df7aecbce May 19 12:25:22.220094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-486163017 May 19 12:25:22.220094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-VolumesSnapshotsTestJSON-486163017-project May 19 12:25:22.220094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:25:22.220094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:25:22.220094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: d8e636431a2e46c7aed3776e50b04523 May 19 12:25:22.220094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-VolumesSnapshotsTestJSON-486163017-project May 19 12:25:22.220094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: May 19 12:25:22.220094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. May 19 12:25:22.220094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': '2527c014-81ce-4c94-8e86-8a5495963ef6'} May 19 12:25:22.220094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:25:22.221018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:22.221018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:25:22.221018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:25:22.221018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 12:25:22.221018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 12:25:22.221018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 12:25:22.221018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 12:25:22.221018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:25:22.221018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:25:22.221018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:25:22.221018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:25:22.221018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:25:22.221018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:25:22.221018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:25:22.221018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:25:22.221018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. (HTTP 404) (Request-ID: req-1209be20-cd30-4773-ad96-ca0315850367) May 19 12:25:22.221018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:22.221018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:22.221018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:22.222394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:22.222394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 12:25:22.222394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 12:25:22.222394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 12:25:22.222394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 12:25:22.222394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 12:25:22.222394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 12:25:22.222394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 12:25:22.222394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 12:25:22.222394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:25:22.222394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:25:22.222394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 12:25:22.222394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 12:25:22.222394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 12:25:22.222394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 12:25:22.222394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:25:22.222394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:25:22.222394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:25:22.222394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:25:22.223763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:25:22.223763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:25:22.223763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:25:22.223763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:25:22.223763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. May 19 12:25:22.223763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:22.223763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:22.223763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:22.223763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:22.223763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:22.223763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:22.223763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:25:22.223763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:25:22.223763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:25:22.223763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:25:22.223763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:25:22.223763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:25:22.223763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 12:25:22.223763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:25:22.225163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. May 19 12:25:22.225163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:22.225163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:22.225163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:22.225163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:22.225163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:22.225163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:22.225163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:25:22.225163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:25:22.225163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. May 19 12:25:22.225163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:22.225163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-78fdcb07-ea38-4ab7-8fa0-a2d8e04b3423 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Returning 404 to user: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:25:22.225163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-78fdcb07-ea38-4ab7-8fa0-a2d8e04b3423 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2527c014-81ce-4c94-8e86-8a5495963ef6" status: 404 len: 109 microversion: 2.1 time: 0.037671 May 19 12:25:22.225163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 432/810] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 19 12:25:22 2022] GET /compute/v2.1/os-volumes/2527c014-81ce-4c94-8e86-8a5495963ef6 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:25:22.231730 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-237e2033-c588-43a1-a39a-cdd52ed84111 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Calling method '.version_select at 0x7f3ba296d550>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:22.262701 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-237e2033-c588-43a1-a39a-cdd52ed84111 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] HTTP exception thrown: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-237e2033-c588-43a1-a39a-cdd52ed84111 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Request method failure captured: May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: DELETE /compute/v2.1/os-volumes/2527c014-81ce-4c94-8e86-8a5495963ef6 HTTP/1.1 May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjcmvDwAoDFmBwVv2N7_YxGxtgGjuIVYDwC7_xOxsyyHOJK2fukHSN7q6r1jCC5N-NFPvw84f_QwrysaFSvvMKD3hdiPrziHe_ypJdW1UYu84gy1sJuS9aCR6lAuwc1l7V3znwLeJH4usNRnO3SE-Qb2PNuYCHo2nLrkwR6HMxsSEwM May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 54a9930dd8cf4efdbd257f9df7aecbce May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-486163017 May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:25:22.265050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:25:22.266576 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_54a9930dd8cf4efdbd257f9df7aecbce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/54a9930dd8cf4efdbd257f9df7aecbce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/54a9930dd8cf4efdbd257f9df7aecbce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/54a9930dd8cf4efdbd257f9df7aecbce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:25:22.266576 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-VolumesSnapshotsTestJSON-486163017 May 19 12:25:22.266576 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 54a9930dd8cf4efdbd257f9df7aecbce May 19 12:25:22.266576 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-486163017 May 19 12:25:22.266576 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-VolumesSnapshotsTestJSON-486163017-project May 19 12:25:22.266576 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:25:22.266576 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:25:22.266576 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: d8e636431a2e46c7aed3776e50b04523 May 19 12:25:22.266576 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-VolumesSnapshotsTestJSON-486163017-project May 19 12:25:22.266576 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: May 19 12:25:22.266576 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. May 19 12:25:22.266576 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': '2527c014-81ce-4c94-8e86-8a5495963ef6'} May 19 12:25:22.266576 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:25:22.267542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:22.267542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:25:22.267542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:25:22.267542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 12:25:22.267542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 12:25:22.267542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 12:25:22.267542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 12:25:22.267542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 12:25:22.267542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 12:25:22.267542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 12:25:22.267542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 12:25:22.267542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:25:22.267542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:25:22.267542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:25:22.267542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:25:22.267542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. (HTTP 404) (Request-ID: req-8035e750-f560-4956-ad3e-c6b1c193ea22) May 19 12:25:22.267542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:25:22.267542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:22.267542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:25:22.269044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:22.269044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 12:25:22.269044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 12:25:22.269044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 12:25:22.269044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 12:25:22.269044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 12:25:22.269044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 12:25:22.269044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 12:25:22.269044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 12:25:22.269044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:25:22.269044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:25:22.269044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 12:25:22.269044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 12:25:22.269044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 12:25:22.269044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 12:25:22.269044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 12:25:22.269044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 12:25:22.269044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 12:25:22.269044 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 12:25:22.270427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:25:22.270427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:25:22.270427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:25:22.270427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:25:22.270427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. May 19 12:25:22.270427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:25:22.270427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:22.270427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:25:22.270427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:22.270427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:22.270427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:22.270427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:25:22.270427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:25:22.270427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:25:22.270427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:25:22.270427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:25:22.270427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:25:22.270427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 12:25:22.270427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:25:22.271727 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. May 19 12:25:22.271727 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:25:22.271727 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:22.271727 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:25:22.271727 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:22.271727 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:22.271727 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:22.271727 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:25:22.271727 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:25:22.271727 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. May 19 12:25:22.271727 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:25:22.271727 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-237e2033-c588-43a1-a39a-cdd52ed84111 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Returning 404 to user: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:25:22.271727 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-237e2033-c588-43a1-a39a-cdd52ed84111 tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/2527c014-81ce-4c94-8e86-8a5495963ef6" status: 404 len: 109 microversion: 2.1 time: 0.038585 May 19 12:25:22.271727 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 379/811] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 19 12:25:22 2022] DELETE /compute/v2.1/os-volumes/2527c014-81ce-4c94-8e86-8a5495963ef6 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:25:22.275120 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-947db0a2-bfaa-4600-9af6-4f6676f07bad tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Calling method '.version_select at 0x7f3ba29d2820>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:22.303704 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-947db0a2-bfaa-4600-9af6-4f6676f07bad tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] HTTP exception thrown: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-947db0a2-bfaa-4600-9af6-4f6676f07bad tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Request method failure captured: May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/os-volumes/2527c014-81ce-4c94-8e86-8a5495963ef6 HTTP/1.1 May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjcmvDwAoDFmBwVv2N7_YxGxtgGjuIVYDwC7_xOxsyyHOJK2fukHSN7q6r1jCC5N-NFPvw84f_QwrysaFSvvMKD3hdiPrziHe_ypJdW1UYu84gy1sJuS9aCR6lAuwc1l7V3znwLeJH4usNRnO3SE-Qb2PNuYCHo2nLrkwR6HMxsSEwM May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 54a9930dd8cf4efdbd257f9df7aecbce May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-486163017 May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:25:22.305760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:25:22.307214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_54a9930dd8cf4efdbd257f9df7aecbce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/54a9930dd8cf4efdbd257f9df7aecbce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/54a9930dd8cf4efdbd257f9df7aecbce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/54a9930dd8cf4efdbd257f9df7aecbce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:25:22.307214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-VolumesSnapshotsTestJSON-486163017 May 19 12:25:22.307214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 54a9930dd8cf4efdbd257f9df7aecbce May 19 12:25:22.307214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-486163017 May 19 12:25:22.307214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-VolumesSnapshotsTestJSON-486163017-project May 19 12:25:22.307214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:25:22.307214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:25:22.307214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: d8e636431a2e46c7aed3776e50b04523 May 19 12:25:22.307214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-VolumesSnapshotsTestJSON-486163017-project May 19 12:25:22.307214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: May 19 12:25:22.307214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. May 19 12:25:22.307214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': '2527c014-81ce-4c94-8e86-8a5495963ef6'} May 19 12:25:22.307214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:25:22.308110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:22.308110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:25:22.308110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:25:22.308110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 12:25:22.308110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 12:25:22.308110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 12:25:22.308110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 12:25:22.308110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:25:22.308110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:25:22.308110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:25:22.308110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:25:22.308110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:25:22.308110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:25:22.308110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:25:22.308110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:25:22.308110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. (HTTP 404) (Request-ID: req-41b9ea53-adc7-4588-99b3-1944f8734087) May 19 12:25:22.308110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:22.308110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:22.308110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:22.309208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:22.309208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 12:25:22.309208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 12:25:22.309208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 12:25:22.309208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 12:25:22.309208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 12:25:22.309208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 12:25:22.309208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 12:25:22.309208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 12:25:22.309208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:25:22.309208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:25:22.309208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 12:25:22.309208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 12:25:22.309208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 12:25:22.309208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 12:25:22.309208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:25:22.309208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:25:22.309208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:25:22.309208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:25:22.310257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:25:22.310257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:25:22.310257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:25:22.310257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:25:22.310257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. May 19 12:25:22.310257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:22.310257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:22.310257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:22.310257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:22.310257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:22.310257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:22.310257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:25:22.310257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:25:22.310257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:25:22.310257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:25:22.310257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:25:22.310257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:25:22.310257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 12:25:22.310257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:25:22.311702 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. May 19 12:25:22.311702 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:22.311702 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:22.311702 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:22.311702 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:22.311702 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:22.311702 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:22.311702 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:25:22.311702 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:25:22.311702 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. May 19 12:25:22.311702 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:22.311702 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-947db0a2-bfaa-4600-9af6-4f6676f07bad tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] Returning 404 to user: Volume 2527c014-81ce-4c94-8e86-8a5495963ef6 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:25:22.311702 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-947db0a2-bfaa-4600-9af6-4f6676f07bad tempest-VolumesSnapshotsTestJSON-486163017 tempest-VolumesSnapshotsTestJSON-486163017-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2527c014-81ce-4c94-8e86-8a5495963ef6" status: 404 len: 109 microversion: 2.1 time: 0.035776 May 19 12:25:22.311702 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 433/812] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 19 12:25:22 2022] GET /compute/v2.1/os-volumes/2527c014-81ce-4c94-8e86-8a5495963ef6 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:25:22.729803 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-8024db0f-0991-4c66-995c-ecba65c1a204 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:22.730774 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-8024db0f-0991-4c66-995c-ecba65c1a204 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:22.738625 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8024db0f-0991-4c66-995c-ecba65c1a204 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:22.739075 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8024db0f-0991-4c66-995c-ecba65c1a204 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:22.739919 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8024db0f-0991-4c66-995c-ecba65c1a204 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:22.740359 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8024db0f-0991-4c66-995c-ecba65c1a204 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:22.772176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-8024db0f-0991-4c66-995c-ecba65c1a204 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046419 May 19 12:25:22.772751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 380/813] 10.222.0.23 () {60 vars in 1342 bytes} [Thu May 19 12:25:22 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:22.834395 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-01572ee0-fc0c-40a3-84aa-771f9fa9b2c4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:22.834928 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-01572ee0-fc0c-40a3-84aa-771f9fa9b2c4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:22.841301 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-01572ee0-fc0c-40a3-84aa-771f9fa9b2c4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:22.841823 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-01572ee0-fc0c-40a3-84aa-771f9fa9b2c4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:22.842613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-01572ee0-fc0c-40a3-84aa-771f9fa9b2c4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:22.843046 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-01572ee0-fc0c-40a3-84aa-771f9fa9b2c4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:22.871954 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-01572ee0-fc0c-40a3-84aa-771f9fa9b2c4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:25:23.164569 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-971139fe-b278-4875-be23-916191648b45 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:23.165173 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-971139fe-b278-4875-be23-916191648b45 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:23.172609 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-971139fe-b278-4875-be23-916191648b45 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:23.173094 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-971139fe-b278-4875-be23-916191648b45 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:23.177567 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-971139fe-b278-4875-be23-916191648b45 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:23.177567 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-971139fe-b278-4875-be23-916191648b45 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:23.344045 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-01572ee0-fc0c-40a3-84aa-771f9fa9b2c4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 204 len: 0 microversion: 2.20 time: 0.513628 May 19 12:25:23.344912 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 434/814] 10.222.0.23 () {60 vars in 1279 bytes} [Thu May 19 12:25:22 2022] DELETE /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 12:25:23.355307 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5b826e97-60fa-4111-ac1a-23b3d2161ffd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:23.356020 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5b826e97-60fa-4111-ac1a-23b3d2161ffd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:23.363125 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5b826e97-60fa-4111-ac1a-23b3d2161ffd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:23.363689 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5b826e97-60fa-4111-ac1a-23b3d2161ffd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:23.364566 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5b826e97-60fa-4111-ac1a-23b3d2161ffd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:23.364999 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5b826e97-60fa-4111-ac1a-23b3d2161ffd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:23.373363 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-971139fe-b278-4875-be23-916191648b45 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:23.387664 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-971139fe-b278-4875-be23-916191648b45 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1570 microversion: 2.1 time: 0.226655 May 19 12:25:23.389043 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 381/815] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:23 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1570 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:23.418327 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-912b2a30-de6c-435f-a6b3-7020ae6de187 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:23.419337 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-912b2a30-de6c-435f-a6b3-7020ae6de187 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:23.430188 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-912b2a30-de6c-435f-a6b3-7020ae6de187 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:23.430640 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-912b2a30-de6c-435f-a6b3-7020ae6de187 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:23.431512 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-912b2a30-de6c-435f-a6b3-7020ae6de187 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:23.432267 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-912b2a30-de6c-435f-a6b3-7020ae6de187 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:23.566110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5b826e97-60fa-4111-ac1a-23b3d2161ffd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:23.574311 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5b826e97-60fa-4111-ac1a-23b3d2161ffd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:23.575826 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5b826e97-60fa-4111-ac1a-23b3d2161ffd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:23.577029 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5b826e97-60fa-4111-ac1a-23b3d2161ffd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1722 microversion: 2.20 time: 0.226335 May 19 12:25:23.577588 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 435/816] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:23 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:25:23.833360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-912b2a30-de6c-435f-a6b3-7020ae6de187 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "POST /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e/action" status: 202 len: 0 microversion: 2.1 time: 0.422619 May 19 12:25:23.833949 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 382/817] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 19 12:25:23 2022] POST /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:25:23.842034 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1b8356f4-d5e3-4e34-bb75-3998939bc52e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:23.842634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1b8356f4-d5e3-4e34-bb75-3998939bc52e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:23.851356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1b8356f4-d5e3-4e34-bb75-3998939bc52e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:23.851827 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1b8356f4-d5e3-4e34-bb75-3998939bc52e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:23.852600 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1b8356f4-d5e3-4e34-bb75-3998939bc52e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:23.853032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1b8356f4-d5e3-4e34-bb75-3998939bc52e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:24.175196 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1b8356f4-d5e3-4e34-bb75-3998939bc52e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:24.183591 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1b8356f4-d5e3-4e34-bb75-3998939bc52e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1518 microversion: 2.1 time: 0.345330 May 19 12:25:24.194580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 436/818] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:23 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1518 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:24.234407 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-709b7878-a0bd-4a03-88cd-b79f98b35dda req-b9296a4f-04c4-4c4b-a189-87db57c0f3cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9431305d-b1c8-46c1-9625-0d2e0643174e", "name": "network-vif-unplugged", "status": "completed", "tag": "d1aaf37f-d3ed-4dc1-91e2-f291ae051dbf"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:24.244066 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-709b7878-a0bd-4a03-88cd-b79f98b35dda req-b9296a4f-04c4-4c4b-a189-87db57c0f3cc service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:24.244588 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-709b7878-a0bd-4a03-88cd-b79f98b35dda req-b9296a4f-04c4-4c4b-a189-87db57c0f3cc service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:24.258756 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.compute.server_external_events [req-709b7878-a0bd-4a03-88cd-b79f98b35dda req-b9296a4f-04c4-4c4b-a189-87db57c0f3cc service nova] Unable to find a host for instance 9431305d-b1c8-46c1-9625-0d2e0643174e. Dropping event network-vif-unplugged {{(pid=117964) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 12:25:24.259843 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-709b7878-a0bd-4a03-88cd-b79f98b35dda req-b9296a4f-04c4-4c4b-a189-87db57c0f3cc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030849 May 19 12:25:24.264841 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 383/819] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 19 12:25:24.597851 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a4f3abd5-f9b5-4c4a-8c13-d47b0c5a275b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:24.599659 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a4f3abd5-f9b5-4c4a-8c13-d47b0c5a275b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:24.605976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a4f3abd5-f9b5-4c4a-8c13-d47b0c5a275b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:24.606424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a4f3abd5-f9b5-4c4a-8c13-d47b0c5a275b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:24.607196 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a4f3abd5-f9b5-4c4a-8c13-d47b0c5a275b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:24.607631 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a4f3abd5-f9b5-4c4a-8c13-d47b0c5a275b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:24.755196 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a4f3abd5-f9b5-4c4a-8c13-d47b0c5a275b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:24.764294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a4f3abd5-f9b5-4c4a-8c13-d47b0c5a275b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:24.765815 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a4f3abd5-f9b5-4c4a-8c13-d47b0c5a275b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:24.770312 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a4f3abd5-f9b5-4c4a-8c13-d47b0c5a275b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1722 microversion: 2.20 time: 0.174909 May 19 12:25:24.770312 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 437/820] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:24 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:25.139105 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-7a709b75-e0ac-4572-8ee2-cfd37c3d87ea tempest-VolumesGetTestJSON-1749276128 tempest-VolumesGetTestJSON-1749276128-project] Action: 'create', calling method: .version_select at 0x7f3ba29b88b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-108611266", "metadata": {"Type": "work"}}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:25.201684 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2fc1498f-3325-4cd1-a90a-102fd46c8f1e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:25.202292 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2fc1498f-3325-4cd1-a90a-102fd46c8f1e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:25.208875 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2fc1498f-3325-4cd1-a90a-102fd46c8f1e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:25.209327 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2fc1498f-3325-4cd1-a90a-102fd46c8f1e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:25.210075 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2fc1498f-3325-4cd1-a90a-102fd46c8f1e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:25.210510 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2fc1498f-3325-4cd1-a90a-102fd46c8f1e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:25.348461 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2fc1498f-3325-4cd1-a90a-102fd46c8f1e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:25.356373 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2fc1498f-3325-4cd1-a90a-102fd46c8f1e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1520 microversion: 2.1 time: 0.158370 May 19 12:25:25.356945 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 438/821] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:25 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:25.787902 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bcc61976-f111-4e23-ba7f-1542038f9e14 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:25.788518 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bcc61976-f111-4e23-ba7f-1542038f9e14 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:25.794718 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bcc61976-f111-4e23-ba7f-1542038f9e14 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:25.795169 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bcc61976-f111-4e23-ba7f-1542038f9e14 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:25.795989 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bcc61976-f111-4e23-ba7f-1542038f9e14 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:25.796430 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bcc61976-f111-4e23-ba7f-1542038f9e14 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:25.949786 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bcc61976-f111-4e23-ba7f-1542038f9e14 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:25.952613 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-7a709b75-e0ac-4572-8ee2-cfd37c3d87ea tempest-VolumesGetTestJSON-1749276128 tempest-VolumesGetTestJSON-1749276128-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.932300 May 19 12:25:25.953724 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 384/822] 10.222.0.23 () {60 vars in 1155 bytes} [Thu May 19 12:25:25 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 934 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 19 12:25:25.959382 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bcc61976-f111-4e23-ba7f-1542038f9e14 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:25.961288 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bcc61976-f111-4e23-ba7f-1542038f9e14 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:25.962550 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bcc61976-f111-4e23-ba7f-1542038f9e14 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1722 microversion: 2.20 time: 0.179994 May 19 12:25:25.963634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 439/823] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:25 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:25:25.965830 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b5a29ba2-9db7-4ddd-bdd4-105327464fef tempest-VolumesGetTestJSON-1749276128 tempest-VolumesGetTestJSON-1749276128-project] Calling method '.version_select at 0x7f3b9d8544c0>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:26.023745 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b5a29ba2-9db7-4ddd-bdd4-105327464fef tempest-VolumesGetTestJSON-1749276128 tempest-VolumesGetTestJSON-1749276128-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/813fa61f-b918-4bc4-99a2-25a446e4dc86" status: 200 len: 352 microversion: 2.1 time: 0.062054 May 19 12:25:26.024786 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 385/824] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 19 12:25:25 2022] GET /compute/v2.1/os-volumes/813fa61f-b918-4bc4-99a2-25a446e4dc86 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:26.378276 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-33c3a19b-7bf1-4cd0-9cac-6c79a7bde774 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:26.378887 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-33c3a19b-7bf1-4cd0-9cac-6c79a7bde774 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:26.385953 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33c3a19b-7bf1-4cd0-9cac-6c79a7bde774 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:26.386642 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33c3a19b-7bf1-4cd0-9cac-6c79a7bde774 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:26.387165 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33c3a19b-7bf1-4cd0-9cac-6c79a7bde774 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:26.387605 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33c3a19b-7bf1-4cd0-9cac-6c79a7bde774 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:26.552941 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-33c3a19b-7bf1-4cd0-9cac-6c79a7bde774 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:26.561418 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-33c3a19b-7bf1-4cd0-9cac-6c79a7bde774 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1520 microversion: 2.1 time: 0.187781 May 19 12:25:26.562011 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 440/825] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:26 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:26.682397 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-05ebca57-33d7-48e7-88a8-7f7a2855542b req-26ab90ff-9fb7-400e-8964-52a7fb19c507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aedab7fb-ae90-48e1-8745-626d60c88a1a", "name": "network-vif-deleted", "tag": "5fc43837-dd78-4f9a-ab74-cfe109a4819d"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:26.693349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-05ebca57-33d7-48e7-88a8-7f7a2855542b req-26ab90ff-9fb7-400e-8964-52a7fb19c507 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:26.693903 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-05ebca57-33d7-48e7-88a8-7f7a2855542b req-26ab90ff-9fb7-400e-8964-52a7fb19c507 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:26.698220 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:26.704948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-05ebca57-33d7-48e7-88a8-7f7a2855542b req-26ab90ff-9fb7-400e-8964-52a7fb19c507 service nova] Creating event network-vif-deleted:5fc43837-dd78-4f9a-ab74-cfe109a4819d for instance aedab7fb-ae90-48e1-8745-626d60c88a1a on hv-cinder-80475 May 19 12:25:26.710574 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-05ebca57-33d7-48e7-88a8-7f7a2855542b req-26ab90ff-9fb7-400e-8964-52a7fb19c507 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032457 May 19 12:25:26.711497 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 386/826] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:26.982551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-48df5486-d91a-4d6d-a287-54864a70db5e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:26.983435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-48df5486-d91a-4d6d-a287-54864a70db5e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:26.999326 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-48df5486-d91a-4d6d-a287-54864a70db5e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:26.999865 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-48df5486-d91a-4d6d-a287-54864a70db5e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:27.000697 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-48df5486-d91a-4d6d-a287-54864a70db5e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:27.001160 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-48df5486-d91a-4d6d-a287-54864a70db5e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:27.037801 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-48df5486-d91a-4d6d-a287-54864a70db5e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:27.038307 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-48df5486-d91a-4d6d-a287-54864a70db5e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:27.039070 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-48df5486-d91a-4d6d-a287-54864a70db5e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lazy-loading 'fault' on Instance uuid aedab7fb-ae90-48e1-8745-626d60c88a1a {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:25:27.040736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-359e9772-042f-4bf8-ac58-6691985de24f tempest-VolumesGetTestJSON-1749276128 tempest-VolumesGetTestJSON-1749276128-project] Calling method '.version_select at 0x7f3ba2a0bb80>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:27.090758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-48df5486-d91a-4d6d-a287-54864a70db5e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:27.104158 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-359e9772-042f-4bf8-ac58-6691985de24f tempest-VolumesGetTestJSON-1749276128 tempest-VolumesGetTestJSON-1749276128-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/813fa61f-b918-4bc4-99a2-25a446e4dc86" status: 200 len: 352 microversion: 2.1 time: 0.068475 May 19 12:25:27.104624 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-48df5486-d91a-4d6d-a287-54864a70db5e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:27.105167 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 387/827] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 19 12:25:27 2022] GET /compute/v2.1/os-volumes/813fa61f-b918-4bc4-99a2-25a446e4dc86 => generated 352 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:27.109758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-48df5486-d91a-4d6d-a287-54864a70db5e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:27.111085 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-48df5486-d91a-4d6d-a287-54864a70db5e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 200 len: 1370 microversion: 2.20 time: 0.132588 May 19 12:25:27.112673 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 441/828] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:26 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 1370 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:27.578577 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-94e30ff3-4539-40eb-b897-5625544ed38e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:27.579330 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-94e30ff3-4539-40eb-b897-5625544ed38e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:27.587338 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-94e30ff3-4539-40eb-b897-5625544ed38e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:27.587875 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-94e30ff3-4539-40eb-b897-5625544ed38e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:27.588676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-94e30ff3-4539-40eb-b897-5625544ed38e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:27.589113 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-94e30ff3-4539-40eb-b897-5625544ed38e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:27.746762 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-94e30ff3-4539-40eb-b897-5625544ed38e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:27.754687 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-94e30ff3-4539-40eb-b897-5625544ed38e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1576 microversion: 2.1 time: 0.179981 May 19 12:25:27.755257 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 388/829] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:27 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:28.117673 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8e393c34-c08c-40bd-a2c5-261d2b3907e6 tempest-VolumesGetTestJSON-1749276128 tempest-VolumesGetTestJSON-1749276128-project] Calling method '.version_select at 0x7f3ba2a2fc10>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:28.130602 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0ebb4273-5c14-40f8-9ed4-4e4f4a12e001 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:28.131242 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0ebb4273-5c14-40f8-9ed4-4e4f4a12e001 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:28.145961 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0ebb4273-5c14-40f8-9ed4-4e4f4a12e001 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:28.146424 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0ebb4273-5c14-40f8-9ed4-4e4f4a12e001 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:28.147218 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0ebb4273-5c14-40f8-9ed4-4e4f4a12e001 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:28.147701 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0ebb4273-5c14-40f8-9ed4-4e4f4a12e001 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:28.167661 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-0ebb4273-5c14-40f8-9ed4-4e4f4a12e001 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] HTTP exception thrown: Instance aedab7fb-ae90-48e1-8745-626d60c88a1a could not be found. May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0ebb4273-5c14-40f8-9ed4-4e4f4a12e001 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Request method failure captured: May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a HTTP/1.1 May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjX3N508CfDjsmLKRPHzYw1H4OXVLk2qEHIkh1YpnoBEsMHk0TUwiaWh7zVeV31Tf5zgvDfHiCup9QoxosUe_PEzfDcrOEujHxU0myHR7Sx7cWffxMvj4aW4rxicJDecqp1zd8m9FrH8aeYF6tpKTCoDZ_8CAPEfkzsUUPlULHWsTbA May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Openstack-Nova-Api-Version: 2.20 May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 1952e5f71bb245de912a1249fd7f6167 May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1044180776 May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:25:28.170855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:25:28.172517 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:25:28.172517 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1044180776 May 19 12:25:28.172517 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 1952e5f71bb245de912a1249fd7f6167 May 19 12:25:28.172517 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1044180776 May 19 12:25:28.172517 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-AttachVolumeShelveTestJSON-1044180776-project May 19 12:25:28.172517 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:25:28.172517 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:25:28.172517 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: 3cdc4cc4d83b4495aa44de70147a001c May 19 12:25:28.172517 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1044180776-project May 19 12:25:28.172517 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:25:28.172517 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance aedab7fb-ae90-48e1-8745-626d60c88a1a could not be found. May 19 12:25:28.172517 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': 'aedab7fb-ae90-48e1-8745-626d60c88a1a'} May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aedab7fb-ae90-48e1-8745-626d60c88a1a could not be found. May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:25:28.173398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:25:28.174824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:25:28.174824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:25:28.174824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:25:28.174824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:25:28.174824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:25:28.174824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:25:28.174824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:25:28.174824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aedab7fb-ae90-48e1-8745-626d60c88a1a could not be found. May 19 12:25:28.174824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:25:28.174824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:28.174824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:25:28.174824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:28.174824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:28.174824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:28.174824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:25:28.174824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:25:28.174824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aedab7fb-ae90-48e1-8745-626d60c88a1a could not be found. May 19 12:25:28.174824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:25:28.176095 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0ebb4273-5c14-40f8-9ed4-4e4f4a12e001 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Returning 404 to user: Instance aedab7fb-ae90-48e1-8745-626d60c88a1a could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:25:28.176182 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8e393c34-c08c-40bd-a2c5-261d2b3907e6 tempest-VolumesGetTestJSON-1749276128 tempest-VolumesGetTestJSON-1749276128-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/813fa61f-b918-4bc4-99a2-25a446e4dc86" status: 200 len: 353 microversion: 2.1 time: 0.058869 May 19 12:25:28.176282 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0ebb4273-5c14-40f8-9ed4-4e4f4a12e001 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 404 len: 111 microversion: 2.20 time: 0.045812 May 19 12:25:28.176282 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 389/830] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:28 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 12:25:28.179693 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 442/831] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 19 12:25:28 2022] GET /compute/v2.1/os-volumes/813fa61f-b918-4bc4-99a2-25a446e4dc86 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:28.182574 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c9f05a8b-aadd-4898-ada2-8674dd47a0c8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '.version_select at 0x7f3b9d83d5e0>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:28.185085 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-60f955d0-68e9-426b-8407-d6f7b1c2df0e tempest-VolumesGetTestJSON-1749276128 tempest-VolumesGetTestJSON-1749276128-project] Calling method '.version_select at 0x7f3ba2a245e0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:28.235748 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-60f955d0-68e9-426b-8407-d6f7b1c2df0e tempest-VolumesGetTestJSON-1749276128 tempest-VolumesGetTestJSON-1749276128-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/813fa61f-b918-4bc4-99a2-25a446e4dc86" status: 200 len: 353 microversion: 2.1 time: 0.054658 May 19 12:25:28.236496 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 443/832] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 19 12:25:28 2022] GET /compute/v2.1/os-volumes/813fa61f-b918-4bc4-99a2-25a446e4dc86 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:28.254722 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e1aa4c8a-72c0-4cdd-a95e-bf37bb8a5363 tempest-VolumesGetTestJSON-1749276128 tempest-VolumesGetTestJSON-1749276128-project] Calling method '.version_select at 0x7f3ba2970af0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:28.292396 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c9f05a8b-aadd-4898-ada2-8674dd47a0c8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-202723125" status: 204 len: 0 microversion: 2.20 time: 0.113771 May 19 12:25:28.292987 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 390/833] 10.222.0.23 () {60 vars in 1258 bytes} [Thu May 19 12:25:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-202723125 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 19 12:25:28.517556 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e1aa4c8a-72c0-4cdd-a95e-bf37bb8a5363 tempest-VolumesGetTestJSON-1749276128 tempest-VolumesGetTestJSON-1749276128-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/813fa61f-b918-4bc4-99a2-25a446e4dc86" status: 202 len: 0 microversion: 2.1 time: 0.267402 May 19 12:25:28.518724 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 444/834] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 19 12:25:28 2022] DELETE /compute/v2.1/os-volumes/813fa61f-b918-4bc4-99a2-25a446e4dc86 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 12:25:28.527250 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b273c4ce-6845-4533-82e3-5c28f3f3dd73 tempest-VolumesGetTestJSON-1749276128 tempest-VolumesGetTestJSON-1749276128-project] Calling method '.version_select at 0x7f3b9d869e50>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:28.579623 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b273c4ce-6845-4533-82e3-5c28f3f3dd73 tempest-VolumesGetTestJSON-1749276128 tempest-VolumesGetTestJSON-1749276128-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/813fa61f-b918-4bc4-99a2-25a446e4dc86" status: 200 len: 352 microversion: 2.1 time: 0.054247 May 19 12:25:28.579623 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 391/835] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 19 12:25:28 2022] GET /compute/v2.1/os-volumes/813fa61f-b918-4bc4-99a2-25a446e4dc86 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:28.772697 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-18d1288a-31b2-451d-9aa6-c18481a43bde tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:28.773335 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-18d1288a-31b2-451d-9aa6-c18481a43bde tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:28.776558 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:28.780094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-18d1288a-31b2-451d-9aa6-c18481a43bde tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:28.780544 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-18d1288a-31b2-451d-9aa6-c18481a43bde tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:28.781315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-18d1288a-31b2-451d-9aa6-c18481a43bde tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:28.781747 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-18d1288a-31b2-451d-9aa6-c18481a43bde tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:28.964351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-18d1288a-31b2-451d-9aa6-c18481a43bde tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:28.972314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-18d1288a-31b2-451d-9aa6-c18481a43bde tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1576 microversion: 2.1 time: 0.204577 May 19 12:25:28.972884 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 445/836] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:28 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:29.292997 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-7ed3cefe-6aaf-4dfc-b957-8221370b45af tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Action: 'create', calling method: .version_select at 0x7f3b9d8548b0>, body: {"keypair": {"name": "tempest-keypair-774272841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfDl4E1LykAYJV+mf75fi2N893oCsti9z6vfQbU0SriDt2TEkUYmVf++dzNU7kMyEgRNZQohZqyPfGqJLXd73Th2egmNkj7uTh+pPqIVZ4W1hjdquri5WhHmw4Vw1rfMw=="}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:29.309155 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-7ed3cefe-6aaf-4dfc-b957-8221370b45af tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Getting quotas for project 1952e5f71bb245de912a1249fd7f6167. Resources: {'key_pairs'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:25:29.313328 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-7ed3cefe-6aaf-4dfc-b957-8221370b45af tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Getting quotas for user 3cdc4cc4d83b4495aa44de70147a001c and project 1952e5f71bb245de912a1249fd7f6167. Resources: {'key_pairs'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:25:29.421163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-7ed3cefe-6aaf-4dfc-b957-8221370b45af tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.132524 May 19 12:25:29.421818 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 392/837] 10.222.0.23 () {62 vars in 1199 bytes} [Thu May 19 12:25:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 12:25:29.590492 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8aa4565c-647f-4515-b423-190dd909a7e8 tempest-VolumesGetTestJSON-1749276128 tempest-VolumesGetTestJSON-1749276128-project] Calling method '.version_select at 0x7f3ba2991ee0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:29.623057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-8aa4565c-647f-4515-b423-190dd909a7e8 tempest-VolumesGetTestJSON-1749276128 tempest-VolumesGetTestJSON-1749276128-project] HTTP exception thrown: Volume 813fa61f-b918-4bc4-99a2-25a446e4dc86 could not be found. May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8aa4565c-647f-4515-b423-190dd909a7e8 tempest-VolumesGetTestJSON-1749276128 tempest-VolumesGetTestJSON-1749276128-project] Request method failure captured: May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/os-volumes/813fa61f-b918-4bc4-99a2-25a446e4dc86 HTTP/1.1 May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjc0XXI_y_HKhCDcMJSoIcTY6mMRV4q_MuU5jtsc4j9ZlsxApMbqBK4o4ARitoXKL69Ap8hV7W1VKxXS5saqzJFfccLQCq0DxhtXnTtmuET3AGmvq-jIn2qHRdwPEidSCWUeUc_suxzyQaBW6nR8P85ZgWCQA1Uawjuv7I3QfCqzd7g May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 246503f8f9214c469e1fe0e4ad5957bf May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-VolumesGetTestJSON-1749276128 May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:25:29.625329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:25:29.629535 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_246503f8f9214c469e1fe0e4ad5957bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/246503f8f9214c469e1fe0e4ad5957bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/246503f8f9214c469e1fe0e4ad5957bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/246503f8f9214c469e1fe0e4ad5957bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:25:29.629535 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-VolumesGetTestJSON-1749276128 May 19 12:25:29.629535 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 246503f8f9214c469e1fe0e4ad5957bf May 19 12:25:29.629535 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-VolumesGetTestJSON-1749276128 May 19 12:25:29.629535 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-VolumesGetTestJSON-1749276128-project May 19 12:25:29.629535 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:25:29.629535 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:25:29.629535 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: 880a01daf5294d259744e7b330e142b6 May 19 12:25:29.629535 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-VolumesGetTestJSON-1749276128-project May 19 12:25:29.629535 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: May 19 12:25:29.629535 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Volume 813fa61f-b918-4bc4-99a2-25a446e4dc86 could not be found. May 19 12:25:29.629535 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': '813fa61f-b918-4bc4-99a2-25a446e4dc86'} May 19 12:25:29.629535 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:25:29.630613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:29.630613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:25:29.630613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:25:29.630613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 12:25:29.630613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 12:25:29.630613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 12:25:29.630613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 12:25:29.630613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:25:29.630613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:25:29.630613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:25:29.630613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:25:29.630613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:25:29.630613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:25:29.630613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:25:29.630613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:25:29.630613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 813fa61f-b918-4bc4-99a2-25a446e4dc86 could not be found. (HTTP 404) (Request-ID: req-e496a4c9-9b5f-4770-8a06-4781abf7106d) May 19 12:25:29.630613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:29.630613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:29.630613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:29.631973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:29.631973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 12:25:29.631973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 12:25:29.631973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 12:25:29.631973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 12:25:29.631973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 12:25:29.631973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 12:25:29.631973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 12:25:29.631973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 12:25:29.631973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:25:29.631973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:25:29.631973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 12:25:29.631973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 12:25:29.631973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 12:25:29.631973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 12:25:29.631973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:25:29.631973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:25:29.631973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:25:29.631973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:25:29.633743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:25:29.633743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:25:29.633743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:25:29.633743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:25:29.633743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 813fa61f-b918-4bc4-99a2-25a446e4dc86 could not be found. May 19 12:25:29.633743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:29.633743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:29.633743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:29.633743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:29.633743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:29.633743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:29.633743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:25:29.633743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:25:29.633743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:25:29.633743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:25:29.633743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:25:29.633743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:25:29.633743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 12:25:29.633743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:25:29.635108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 813fa61f-b918-4bc4-99a2-25a446e4dc86 could not be found. May 19 12:25:29.635108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:29.635108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:29.635108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:29.635108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:29.635108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:29.635108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:29.635108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:25:29.635108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:25:29.635108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 813fa61f-b918-4bc4-99a2-25a446e4dc86 could not be found. May 19 12:25:29.635108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:29.635108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8aa4565c-647f-4515-b423-190dd909a7e8 tempest-VolumesGetTestJSON-1749276128 tempest-VolumesGetTestJSON-1749276128-project] Returning 404 to user: Volume 813fa61f-b918-4bc4-99a2-25a446e4dc86 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:25:29.635108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8aa4565c-647f-4515-b423-190dd909a7e8 tempest-VolumesGetTestJSON-1749276128 tempest-VolumesGetTestJSON-1749276128-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/813fa61f-b918-4bc4-99a2-25a446e4dc86" status: 404 len: 109 microversion: 2.1 time: 0.040354 May 19 12:25:29.635108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 446/838] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 19 12:25:29 2022] GET /compute/v2.1/os-volumes/813fa61f-b918-4bc4-99a2-25a446e4dc86 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:25:29.989690 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-8bd44cd1-e2b3-4b19-98bd-b322b2292b8f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:29.990307 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-8bd44cd1-e2b3-4b19-98bd-b322b2292b8f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:29.996729 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8bd44cd1-e2b3-4b19-98bd-b322b2292b8f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:29.997186 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8bd44cd1-e2b3-4b19-98bd-b322b2292b8f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:29.997963 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8bd44cd1-e2b3-4b19-98bd-b322b2292b8f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:29.998487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8bd44cd1-e2b3-4b19-98bd-b322b2292b8f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:30.360198 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-8bd44cd1-e2b3-4b19-98bd-b322b2292b8f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:30.369133 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-8bd44cd1-e2b3-4b19-98bd-b322b2292b8f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1576 microversion: 2.1 time: 0.383416 May 19 12:25:30.369702 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 393/839] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:29 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1576 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:31.387709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3b23931a-ba63-458e-a5a6-f90d5e6c2e23 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:31.389183 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3b23931a-ba63-458e-a5a6-f90d5e6c2e23 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:31.396056 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3b23931a-ba63-458e-a5a6-f90d5e6c2e23 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:31.398071 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3b23931a-ba63-458e-a5a6-f90d5e6c2e23 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:31.398071 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3b23931a-ba63-458e-a5a6-f90d5e6c2e23 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:31.398071 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3b23931a-ba63-458e-a5a6-f90d5e6c2e23 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:31.532421 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3b23931a-ba63-458e-a5a6-f90d5e6c2e23 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:31.540468 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3b23931a-ba63-458e-a5a6-f90d5e6c2e23 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1576 microversion: 2.1 time: 0.157511 May 19 12:25:31.541022 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 447/840] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:31 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:32.488759 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-2a88badc-d7a4-4771-9afc-d70d33f79ad2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:32.489786 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-2a88badc-d7a4-4771-9afc-d70d33f79ad2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:32.496282 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2a88badc-d7a4-4771-9afc-d70d33f79ad2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:32.496891 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2a88badc-d7a4-4771-9afc-d70d33f79ad2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:32.497847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2a88badc-d7a4-4771-9afc-d70d33f79ad2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:32.498349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2a88badc-d7a4-4771-9afc-d70d33f79ad2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:32.508402 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3a611037-3053-4a1d-a83c-79aba469ed7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-97093806", "imageRef": "962252c6-9c2c-4b81-bdb7-f6d317bada3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fae2a519-b2c0-40c8-b8e9-67be2915545e"}], "security_groups": [{"name": "tempest-securitygroup--1695789362"}], "key_name": "tempest-keypair-774272841", "user_data": "}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:32.530912 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-2a88badc-d7a4-4771-9afc-d70d33f79ad2 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047301 May 19 12:25:32.531871 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 394/841] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:25:32 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 12:25:32.568013 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-2d72e94f-46b2-459f-8cbd-ddc11084c25f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:32.568013 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-2d72e94f-46b2-459f-8cbd-ddc11084c25f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:32.568013 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2d72e94f-46b2-459f-8cbd-ddc11084c25f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:32.568013 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2d72e94f-46b2-459f-8cbd-ddc11084c25f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:32.568397 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2d72e94f-46b2-459f-8cbd-ddc11084c25f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:32.568397 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2d72e94f-46b2-459f-8cbd-ddc11084c25f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:32.648506 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-3a611037-3053-4a1d-a83c-79aba469ed7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] validate_networks() for [('fae2a519-b2c0-40c8-b8e9-67be2915545e', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:25:32.780992 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-2d72e94f-46b2-459f-8cbd-ddc11084c25f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:32.790691 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-2d72e94f-46b2-459f-8cbd-ddc11084c25f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1576 microversion: 2.1 time: 0.237157 May 19 12:25:32.791375 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 395/842] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:32 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1576 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:32.796196 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5ff2c767-041a-4007-9cee-69a453f001ca tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:32.796768 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5ff2c767-041a-4007-9cee-69a453f001ca tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:32.803931 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5ff2c767-041a-4007-9cee-69a453f001ca tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:32.804449 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5ff2c767-041a-4007-9cee-69a453f001ca tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:32.808295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5ff2c767-041a-4007-9cee-69a453f001ca tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:32.808295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5ff2c767-041a-4007-9cee-69a453f001ca tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:32.834265 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5ff2c767-041a-4007-9cee-69a453f001ca tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Going to try to terminate instance {{(pid=117964) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:25:33.092272 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-3a611037-3053-4a1d-a83c-79aba469ed7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:25:33.092697 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-3a611037-3053-4a1d-a83c-79aba469ed7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:25:33.093175 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-3a611037-3053-4a1d-a83c-79aba469ed7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:25:33.093909 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-3a611037-3053-4a1d-a83c-79aba469ed7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:25:33.094346 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-3a611037-3053-4a1d-a83c-79aba469ed7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:25:33.103866 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3a611037-3053-4a1d-a83c-79aba469ed7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:33.104311 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3a611037-3053-4a1d-a83c-79aba469ed7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:33.105883 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3a611037-3053-4a1d-a83c-79aba469ed7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:33.105883 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3a611037-3053-4a1d-a83c-79aba469ed7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:33.123146 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-3a611037-3053-4a1d-a83c-79aba469ed7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Getting quotas for project 1952e5f71bb245de912a1249fd7f6167. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:25:33.127530 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-3a611037-3053-4a1d-a83c-79aba469ed7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Getting quotas for user 3cdc4cc4d83b4495aa44de70147a001c and project 1952e5f71bb245de912a1249fd7f6167. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:25:33.139644 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3a611037-3053-4a1d-a83c-79aba469ed7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:25:33.142059 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3a611037-3053-4a1d-a83c-79aba469ed7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962252c6-9c2c-4b81-bdb7-f6d317bada3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:25:33.276521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5ff2c767-041a-4007-9cee-69a453f001ca tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 204 len: 0 microversion: 2.1 time: 0.483518 May 19 12:25:33.277143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 396/843] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:25:32 2022] DELETE /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:25:33.286615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a93de502-cdf0-4bab-8e9a-0edab3317bec tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:33.287374 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a93de502-cdf0-4bab-8e9a-0edab3317bec tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:33.293501 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a93de502-cdf0-4bab-8e9a-0edab3317bec tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:33.293984 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a93de502-cdf0-4bab-8e9a-0edab3317bec tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:33.294759 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a93de502-cdf0-4bab-8e9a-0edab3317bec tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:33.295196 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a93de502-cdf0-4bab-8e9a-0edab3317bec tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:33.326367 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3a611037-3053-4a1d-a83c-79aba469ed7f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.822231 May 19 12:25:33.337541 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 448/844] 10.222.0.23 () {62 vars in 1187 bytes} [Thu May 19 12:25:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 19 12:25:33.342747 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9c2ff80b-4c64-40be-801d-78ba9a3ffdb1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:33.346029 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9c2ff80b-4c64-40be-801d-78ba9a3ffdb1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:33.442628 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9c2ff80b-4c64-40be-801d-78ba9a3ffdb1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:33.453843 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9c2ff80b-4c64-40be-801d-78ba9a3ffdb1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:33.456264 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9c2ff80b-4c64-40be-801d-78ba9a3ffdb1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:33.457677 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9c2ff80b-4c64-40be-801d-78ba9a3ffdb1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1279 microversion: 2.20 time: 0.118861 May 19 12:25:33.458417 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 449/845] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:33 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1279 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:33.483000 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a93de502-cdf0-4bab-8e9a-0edab3317bec tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:33.492104 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a93de502-cdf0-4bab-8e9a-0edab3317bec tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1674 microversion: 2.1 time: 0.210290 May 19 12:25:33.492825 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 397/846] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:33 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1674 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:33.809036 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c7d330f8-eebd-442f-b1df-041405db8252 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:33.809648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c7d330f8-eebd-442f-b1df-041405db8252 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:33.818053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c7d330f8-eebd-442f-b1df-041405db8252 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:33.818513 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c7d330f8-eebd-442f-b1df-041405db8252 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:33.819290 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c7d330f8-eebd-442f-b1df-041405db8252 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:33.819852 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c7d330f8-eebd-442f-b1df-041405db8252 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:33.958855 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c7d330f8-eebd-442f-b1df-041405db8252 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:33.967195 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c7d330f8-eebd-442f-b1df-041405db8252 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1576 microversion: 2.1 time: 0.162134 May 19 12:25:33.977891 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 450/847] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:33 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:34.476325 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-67a2c9e7-dff9-4de7-ad9f-3a3bf006326b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:34.476942 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-67a2c9e7-dff9-4de7-ad9f-3a3bf006326b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:34.479426 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:34.484790 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-67a2c9e7-dff9-4de7-ad9f-3a3bf006326b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:34.485247 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-67a2c9e7-dff9-4de7-ad9f-3a3bf006326b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:34.486039 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-67a2c9e7-dff9-4de7-ad9f-3a3bf006326b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:34.486483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-67a2c9e7-dff9-4de7-ad9f-3a3bf006326b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:34.509571 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-71fdd65f-084b-4e24-8563-a00b147be9bd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:34.510580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-71fdd65f-084b-4e24-8563-a00b147be9bd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:34.516601 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-71fdd65f-084b-4e24-8563-a00b147be9bd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:34.517048 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-71fdd65f-084b-4e24-8563-a00b147be9bd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:34.517854 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-71fdd65f-084b-4e24-8563-a00b147be9bd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:34.518359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-71fdd65f-084b-4e24-8563-a00b147be9bd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:34.554434 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-67a2c9e7-dff9-4de7-ad9f-3a3bf006326b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:34.562999 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-67a2c9e7-dff9-4de7-ad9f-3a3bf006326b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:34.564570 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-67a2c9e7-dff9-4de7-ad9f-3a3bf006326b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:34.566527 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-67a2c9e7-dff9-4de7-ad9f-3a3bf006326b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1283 microversion: 2.20 time: 0.094168 May 19 12:25:34.567291 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 398/848] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:34 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1283 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:34.652652 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-71fdd65f-084b-4e24-8563-a00b147be9bd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:34.662101 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-71fdd65f-084b-4e24-8563-a00b147be9bd tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1674 microversion: 2.1 time: 0.156592 May 19 12:25:34.662712 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 451/849] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:34 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:34.985274 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f1254cd9-e21d-4659-9f33-614efb3cc14f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:34.985928 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f1254cd9-e21d-4659-9f33-614efb3cc14f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:34.996842 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f1254cd9-e21d-4659-9f33-614efb3cc14f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:34.996842 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f1254cd9-e21d-4659-9f33-614efb3cc14f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:34.996842 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f1254cd9-e21d-4659-9f33-614efb3cc14f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:34.996842 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f1254cd9-e21d-4659-9f33-614efb3cc14f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:35.132119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f1254cd9-e21d-4659-9f33-614efb3cc14f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:35.139645 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f1254cd9-e21d-4659-9f33-614efb3cc14f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1576 microversion: 2.1 time: 0.158596 May 19 12:25:35.140236 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 399/850] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:34 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:35.584878 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-24991264-47d0-45ed-af75-5ebc7cc2b59b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:35.585534 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-24991264-47d0-45ed-af75-5ebc7cc2b59b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:35.592608 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24991264-47d0-45ed-af75-5ebc7cc2b59b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:35.593056 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24991264-47d0-45ed-af75-5ebc7cc2b59b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:35.593951 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24991264-47d0-45ed-af75-5ebc7cc2b59b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:35.594272 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24991264-47d0-45ed-af75-5ebc7cc2b59b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:35.661467 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-24991264-47d0-45ed-af75-5ebc7cc2b59b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:35.669495 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-24991264-47d0-45ed-af75-5ebc7cc2b59b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:35.671311 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-24991264-47d0-45ed-af75-5ebc7cc2b59b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:35.672195 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-24991264-47d0-45ed-af75-5ebc7cc2b59b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1275 microversion: 2.20 time: 0.091754 May 19 12:25:35.672743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 452/851] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:35 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:25:35.679218 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-10d7c29f-4966-4f37-bbad-3eea85d80ce3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:35.679859 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-10d7c29f-4966-4f37-bbad-3eea85d80ce3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:35.686564 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-10d7c29f-4966-4f37-bbad-3eea85d80ce3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:35.687027 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-10d7c29f-4966-4f37-bbad-3eea85d80ce3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:35.687823 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-10d7c29f-4966-4f37-bbad-3eea85d80ce3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:35.688272 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-10d7c29f-4966-4f37-bbad-3eea85d80ce3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:35.823706 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-10d7c29f-4966-4f37-bbad-3eea85d80ce3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:35.831894 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-10d7c29f-4966-4f37-bbad-3eea85d80ce3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1674 microversion: 2.1 time: 0.157431 May 19 12:25:35.832463 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 400/852] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:35 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:36.157561 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-75cb3cd8-c2b1-45c4-ab0a-dd8e5982369d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:36.158290 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-75cb3cd8-c2b1-45c4-ab0a-dd8e5982369d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:36.166429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-75cb3cd8-c2b1-45c4-ab0a-dd8e5982369d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:36.167119 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-75cb3cd8-c2b1-45c4-ab0a-dd8e5982369d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:36.168251 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-75cb3cd8-c2b1-45c4-ab0a-dd8e5982369d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:36.169025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-75cb3cd8-c2b1-45c4-ab0a-dd8e5982369d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:36.323666 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-75cb3cd8-c2b1-45c4-ab0a-dd8e5982369d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:36.337484 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-75cb3cd8-c2b1-45c4-ab0a-dd8e5982369d tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1576 microversion: 2.1 time: 0.183655 May 19 12:25:36.348613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 453/853] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:36 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:36.691354 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c394b1cf-eef0-4f6c-8d19-ee92b8a4c56a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:36.691926 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c394b1cf-eef0-4f6c-8d19-ee92b8a4c56a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:36.698532 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c394b1cf-eef0-4f6c-8d19-ee92b8a4c56a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:36.698981 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c394b1cf-eef0-4f6c-8d19-ee92b8a4c56a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:36.699821 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c394b1cf-eef0-4f6c-8d19-ee92b8a4c56a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:36.700240 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c394b1cf-eef0-4f6c-8d19-ee92b8a4c56a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:36.770375 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c394b1cf-eef0-4f6c-8d19-ee92b8a4c56a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:36.779409 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c394b1cf-eef0-4f6c-8d19-ee92b8a4c56a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:36.780946 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c394b1cf-eef0-4f6c-8d19-ee92b8a4c56a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:36.782047 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c394b1cf-eef0-4f6c-8d19-ee92b8a4c56a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1331 microversion: 2.20 time: 0.095454 May 19 12:25:36.782700 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 401/854] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:36 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:36.848641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7167777d-0a56-4a4b-994b-376ec5368c42 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:36.849386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7167777d-0a56-4a4b-994b-376ec5368c42 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:36.856447 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7167777d-0a56-4a4b-994b-376ec5368c42 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:36.856899 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7167777d-0a56-4a4b-994b-376ec5368c42 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:36.857670 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7167777d-0a56-4a4b-994b-376ec5368c42 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:36.858106 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7167777d-0a56-4a4b-994b-376ec5368c42 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:36.863099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:36.928232 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7167777d-0a56-4a4b-994b-376ec5368c42 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:36.943912 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7167777d-0a56-4a4b-994b-376ec5368c42 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1606 microversion: 2.1 time: 0.098633 May 19 12:25:36.943912 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 454/855] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:36 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1606 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:37.163950 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-3b438de8-1613-4215-ba6a-0c33696f88b7 req-8e82f546-56bb-4791-bc5c-0c9f6ed9ef1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68e76015-a6d8-4580-a1ab-4a11f42cb6f0", "name": "network-vif-deleted", "tag": "0269a249-9630-404e-8eb1-a23ce804a3bd"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:37.178461 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-3b438de8-1613-4215-ba6a-0c33696f88b7 req-8e82f546-56bb-4791-bc5c-0c9f6ed9ef1c service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:37.180908 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-3b438de8-1613-4215-ba6a-0c33696f88b7 req-8e82f546-56bb-4791-bc5c-0c9f6ed9ef1c service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:37.218226 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-3b438de8-1613-4215-ba6a-0c33696f88b7 req-8e82f546-56bb-4791-bc5c-0c9f6ed9ef1c service nova] Creating event network-vif-deleted:0269a249-9630-404e-8eb1-a23ce804a3bd for instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 on hv-cinder-80475 May 19 12:25:37.226450 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-3b438de8-1613-4215-ba6a-0c33696f88b7 req-8e82f546-56bb-4791-bc5c-0c9f6ed9ef1c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070436 May 19 12:25:37.230185 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 402/856] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:37.357115 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4bbf10e1-8578-44c2-a2d5-11a98494e2c2 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:37.362484 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4bbf10e1-8578-44c2-a2d5-11a98494e2c2 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:37.370850 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4bbf10e1-8578-44c2-a2d5-11a98494e2c2 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:37.371646 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4bbf10e1-8578-44c2-a2d5-11a98494e2c2 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:37.372704 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4bbf10e1-8578-44c2-a2d5-11a98494e2c2 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:37.373475 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4bbf10e1-8578-44c2-a2d5-11a98494e2c2 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:37.561951 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4bbf10e1-8578-44c2-a2d5-11a98494e2c2 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:37.570330 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4bbf10e1-8578-44c2-a2d5-11a98494e2c2 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1576 microversion: 2.1 time: 0.218960 May 19 12:25:37.572134 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 455/857] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:37 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:37.802199 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-555d4927-8c6e-43df-b3bc-54c2b06ec3a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:37.803960 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-555d4927-8c6e-43df-b3bc-54c2b06ec3a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:37.810989 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-555d4927-8c6e-43df-b3bc-54c2b06ec3a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:37.811448 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-555d4927-8c6e-43df-b3bc-54c2b06ec3a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:37.812278 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-555d4927-8c6e-43df-b3bc-54c2b06ec3a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:37.813836 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-555d4927-8c6e-43df-b3bc-54c2b06ec3a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:37.886823 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-555d4927-8c6e-43df-b3bc-54c2b06ec3a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:37.898629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-555d4927-8c6e-43df-b3bc-54c2b06ec3a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:37.900374 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-555d4927-8c6e-43df-b3bc-54c2b06ec3a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:37.909187 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-555d4927-8c6e-43df-b3bc-54c2b06ec3a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1337 microversion: 2.20 time: 0.110849 May 19 12:25:37.910144 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 403/858] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:37 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1337 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:37.961022 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8f03c03a-3f18-471d-9b24-74565fbf313b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:37.961978 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8f03c03a-3f18-471d-9b24-74565fbf313b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:37.969118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8f03c03a-3f18-471d-9b24-74565fbf313b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:37.969774 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8f03c03a-3f18-471d-9b24-74565fbf313b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:37.974670 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8f03c03a-3f18-471d-9b24-74565fbf313b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:37.974670 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8f03c03a-3f18-471d-9b24-74565fbf313b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:38.007534 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8f03c03a-3f18-471d-9b24-74565fbf313b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:38.008013 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8f03c03a-3f18-471d-9b24-74565fbf313b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:38.008648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-8f03c03a-3f18-471d-9b24-74565fbf313b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lazy-loading 'fault' on Instance uuid 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:25:38.055384 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8f03c03a-3f18-471d-9b24-74565fbf313b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:38.062972 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8f03c03a-3f18-471d-9b24-74565fbf313b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 200 len: 1327 microversion: 2.1 time: 0.106787 May 19 12:25:38.063542 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 456/859] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:37 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:38.444799 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-d6fa5fc7-5485-4eb5-bfc8-dc22c449c4f0 req-dbe45e51-c3ab-4cfe-a88e-6aaa6e79897a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9431305d-b1c8-46c1-9625-0d2e0643174e", "name": "network-vif-plugged", "status": "completed", "tag": "d1aaf37f-d3ed-4dc1-91e2-f291ae051dbf"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:38.463450 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-d6fa5fc7-5485-4eb5-bfc8-dc22c449c4f0 req-dbe45e51-c3ab-4cfe-a88e-6aaa6e79897a service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:38.465667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-d6fa5fc7-5485-4eb5-bfc8-dc22c449c4f0 req-dbe45e51-c3ab-4cfe-a88e-6aaa6e79897a service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:38.501898 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-d6fa5fc7-5485-4eb5-bfc8-dc22c449c4f0 req-dbe45e51-c3ab-4cfe-a88e-6aaa6e79897a service nova] Creating event network-vif-plugged:d1aaf37f-d3ed-4dc1-91e2-f291ae051dbf for instance 9431305d-b1c8-46c1-9625-0d2e0643174e on hv-cinder-80475 May 19 12:25:38.508416 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-d6fa5fc7-5485-4eb5-bfc8-dc22c449c4f0 req-dbe45e51-c3ab-4cfe-a88e-6aaa6e79897a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068039 May 19 12:25:38.509982 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 404/860] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:38.589249 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a56050b9-e4be-4041-af94-352815d60693 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:38.589974 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a56050b9-e4be-4041-af94-352815d60693 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:38.600056 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a56050b9-e4be-4041-af94-352815d60693 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:38.600777 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a56050b9-e4be-4041-af94-352815d60693 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:38.601777 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a56050b9-e4be-4041-af94-352815d60693 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:38.602390 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a56050b9-e4be-4041-af94-352815d60693 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:38.759459 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a56050b9-e4be-4041-af94-352815d60693 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:38.768652 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a56050b9-e4be-4041-af94-352815d60693 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1576 microversion: 2.1 time: 0.183492 May 19 12:25:38.769259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 457/861] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:38 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:38.929201 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f43f9a0b-b86e-41bd-9d1f-9db94c612f91 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:38.930560 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f43f9a0b-b86e-41bd-9d1f-9db94c612f91 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:38.937575 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f43f9a0b-b86e-41bd-9d1f-9db94c612f91 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:38.938026 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f43f9a0b-b86e-41bd-9d1f-9db94c612f91 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:38.938806 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f43f9a0b-b86e-41bd-9d1f-9db94c612f91 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:38.939246 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f43f9a0b-b86e-41bd-9d1f-9db94c612f91 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:39.078974 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f43f9a0b-b86e-41bd-9d1f-9db94c612f91 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:39.082030 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1dfab0f8-5380-4c1e-9d55-2d30c4a62f20 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:39.082719 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1dfab0f8-5380-4c1e-9d55-2d30c4a62f20 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:39.088235 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f43f9a0b-b86e-41bd-9d1f-9db94c612f91 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:39.089252 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1dfab0f8-5380-4c1e-9d55-2d30c4a62f20 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:39.089738 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1dfab0f8-5380-4c1e-9d55-2d30c4a62f20 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:39.089853 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f43f9a0b-b86e-41bd-9d1f-9db94c612f91 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:39.090466 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1dfab0f8-5380-4c1e-9d55-2d30c4a62f20 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:39.090826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f43f9a0b-b86e-41bd-9d1f-9db94c612f91 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1405 microversion: 2.20 time: 0.166491 May 19 12:25:39.090925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1dfab0f8-5380-4c1e-9d55-2d30c4a62f20 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:39.091439 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 405/862] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:38 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:39.104764 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-1dfab0f8-5380-4c1e-9d55-2d30c4a62f20 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] HTTP exception thrown: Instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 could not be found. May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1dfab0f8-5380-4c1e-9d55-2d30c4a62f20 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Request method failure captured: May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 HTTP/1.1 May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjWAocCXltxUECDjW2SE10qI7-nV7Bjf7s1NrL8ad3oNUeGaIx9J9ZzikV5hHDjLClr3P7QbEdIFGLlRqcV7qqQDqiCjmEs4gnp7l4yIuAmzJVyZhzmeB0BoNiZKYrD6lEYM_ge-lVZu-3JWtMIgYVHyxbTDGLHsXUrb2zegdk0JWyQ May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 9eafee25cfb14ca2bd5c10fe41a01644 May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeTestJSON-1559525414 May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:25:39.106294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:25:39.107925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:25:39.107925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeTestJSON-1559525414 May 19 12:25:39.107925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 9eafee25cfb14ca2bd5c10fe41a01644 May 19 12:25:39.107925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1559525414 May 19 12:25:39.107925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeTestJSON-1559525414-project May 19 12:25:39.107925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:25:39.107925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:25:39.107925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: 9d762cce00ae4e468c358b0437f35deb May 19 12:25:39.107925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeTestJSON-1559525414-project May 19 12:25:39.107925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:25:39.107925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 could not be found. May 19 12:25:39.107925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': '68e76015-a6d8-4580-a1ab-4a11f42cb6f0'} May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 could not be found. May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:25:39.108942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:25:39.110681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:25:39.110681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:25:39.110681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:25:39.110681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:25:39.110681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:25:39.110681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:25:39.110681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:25:39.110681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 could not be found. May 19 12:25:39.110681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:39.110681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:39.110681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:39.110681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:39.110681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:39.110681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:39.110681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:25:39.110681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:25:39.110681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 could not be found. May 19 12:25:39.110681 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:25:39.112394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1dfab0f8-5380-4c1e-9d55-2d30c4a62f20 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Returning 404 to user: Instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:25:39.112394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1dfab0f8-5380-4c1e-9d55-2d30c4a62f20 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 404 len: 111 microversion: 2.1 time: 0.030757 May 19 12:25:39.112394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 458/863] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:39 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:25:39.117349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-184c0e04-51a1-42fa-a180-e196deb8084f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '.version_select at 0x7f3b9d83d790>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:39.260859 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-184c0e04-51a1-42fa-a180-e196deb8084f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-939546334" status: 202 len: 0 microversion: 2.1 time: 0.147292 May 19 12:25:39.264187 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 406/864] 10.222.0.23 () {58 vars in 1217 bytes} [Thu May 19 12:25:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-939546334 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:25:39.552645 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-3e5da294-7a62-405a-83b2-324ce019b0e4 req-ea7ad6d8-4dbb-486d-838a-e616cbc6acf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "315fa402-5c50-4d9d-bfba-b2e39a9133ec", "tag": "60a88c1e-75f6-4fbf-9da2-da492fbaa3ed"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:39.566401 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-3e5da294-7a62-405a-83b2-324ce019b0e4 req-ea7ad6d8-4dbb-486d-838a-e616cbc6acf6 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:39.569572 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-3e5da294-7a62-405a-83b2-324ce019b0e4 req-ea7ad6d8-4dbb-486d-838a-e616cbc6acf6 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:39.581859 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-3e5da294-7a62-405a-83b2-324ce019b0e4 req-ea7ad6d8-4dbb-486d-838a-e616cbc6acf6 service nova] Creating event network-changed:60a88c1e-75f6-4fbf-9da2-da492fbaa3ed for instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec on hv-cinder-80475 May 19 12:25:39.588201 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-3e5da294-7a62-405a-83b2-324ce019b0e4 req-ea7ad6d8-4dbb-486d-838a-e616cbc6acf6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040664 May 19 12:25:39.589698 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 459/865] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:39.782678 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=4 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:39.787665 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c17b22ac-f867-47da-b99e-d682a81438a0 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:39.788530 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c17b22ac-f867-47da-b99e-d682a81438a0 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:39.795201 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c17b22ac-f867-47da-b99e-d682a81438a0 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:39.795721 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c17b22ac-f867-47da-b99e-d682a81438a0 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:39.796633 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c17b22ac-f867-47da-b99e-d682a81438a0 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:39.797136 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c17b22ac-f867-47da-b99e-d682a81438a0 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:39.977570 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c17b22ac-f867-47da-b99e-d682a81438a0 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:39.985743 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c17b22ac-f867-47da-b99e-d682a81438a0 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1576 microversion: 2.1 time: 0.203823 May 19 12:25:39.987955 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 407/866] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:39 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1576 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:40.110332 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ccd74d42-a692-4ade-a8b0-26b1958c6cb5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:40.111030 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ccd74d42-a692-4ade-a8b0-26b1958c6cb5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:40.118700 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ccd74d42-a692-4ade-a8b0-26b1958c6cb5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:40.119219 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ccd74d42-a692-4ade-a8b0-26b1958c6cb5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:40.120064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ccd74d42-a692-4ade-a8b0-26b1958c6cb5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:40.120496 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ccd74d42-a692-4ade-a8b0-26b1958c6cb5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:40.349830 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ccd74d42-a692-4ade-a8b0-26b1958c6cb5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:40.353816 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ccd74d42-a692-4ade-a8b0-26b1958c6cb5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:40.357309 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ccd74d42-a692-4ade-a8b0-26b1958c6cb5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:40.358466 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ccd74d42-a692-4ade-a8b0-26b1958c6cb5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1405 microversion: 2.20 time: 0.253236 May 19 12:25:40.359366 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 460/867] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:40 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1405 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:40.360930 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-94cdca65-5a74-4e5c-aaf8-12b78b78b8c9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Action: 'create', calling method: .version_select at 0x7f3b9d8544c0>, body: {"keypair": {"name": "tempest-keypair-884044206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4vHPSwyCU7hV388eMYAMvu7eXNhHxjppHPn0jMPuBFFwj9GrvMsf2sTR3cLTi7wyJjS706QY9tdQv10G52rnkLXYrlqgjnus2RbGU0sUX2xtJ6BqOj4KnAsJMpRZxoGA=="}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:40.378534 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-94cdca65-5a74-4e5c-aaf8-12b78b78b8c9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Getting quotas for project 9eafee25cfb14ca2bd5c10fe41a01644. Resources: {'key_pairs'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:25:40.383112 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-94cdca65-5a74-4e5c-aaf8-12b78b78b8c9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Getting quotas for user 9d762cce00ae4e468c358b0437f35deb and project 9eafee25cfb14ca2bd5c10fe41a01644. Resources: {'key_pairs'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:25:40.477343 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-94cdca65-5a74-4e5c-aaf8-12b78b78b8c9 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.121756 May 19 12:25:40.477950 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 408/868] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 19 12:25:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:41.004236 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0ff0902e-793b-4191-b0b7-aabe670aec3e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:41.004934 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0ff0902e-793b-4191-b0b7-aabe670aec3e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:41.011095 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0ff0902e-793b-4191-b0b7-aabe670aec3e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:41.011542 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0ff0902e-793b-4191-b0b7-aabe670aec3e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:41.012351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0ff0902e-793b-4191-b0b7-aabe670aec3e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:41.012784 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0ff0902e-793b-4191-b0b7-aabe670aec3e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:41.209915 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0ff0902e-793b-4191-b0b7-aabe670aec3e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:41.217855 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0ff0902e-793b-4191-b0b7-aabe670aec3e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1576 microversion: 2.1 time: 0.217782 May 19 12:25:41.218430 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 461/869] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:40 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1576 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:41.379031 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b4da6af4-5e2a-4000-8f65-1ebc517aa89e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:41.379626 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-b4da6af4-5e2a-4000-8f65-1ebc517aa89e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:41.385927 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b4da6af4-5e2a-4000-8f65-1ebc517aa89e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:41.386371 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b4da6af4-5e2a-4000-8f65-1ebc517aa89e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:41.387136 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b4da6af4-5e2a-4000-8f65-1ebc517aa89e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:41.387569 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b4da6af4-5e2a-4000-8f65-1ebc517aa89e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:41.552928 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b4da6af4-5e2a-4000-8f65-1ebc517aa89e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:41.557029 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:41.561944 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b4da6af4-5e2a-4000-8f65-1ebc517aa89e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:41.563493 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b4da6af4-5e2a-4000-8f65-1ebc517aa89e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:41.566015 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b4da6af4-5e2a-4000-8f65-1ebc517aa89e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1405 microversion: 2.20 time: 0.191310 May 19 12:25:41.567120 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 409/870] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:41 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:42.235825 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-64fcfca1-c7e0-4602-9d3e-19191ea425db tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:42.236487 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-64fcfca1-c7e0-4602-9d3e-19191ea425db tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:42.244060 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-64fcfca1-c7e0-4602-9d3e-19191ea425db tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:42.244534 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-64fcfca1-c7e0-4602-9d3e-19191ea425db tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:42.245351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-64fcfca1-c7e0-4602-9d3e-19191ea425db tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:42.245788 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-64fcfca1-c7e0-4602-9d3e-19191ea425db tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:42.391543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-64fcfca1-c7e0-4602-9d3e-19191ea425db tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:42.400531 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-64fcfca1-c7e0-4602-9d3e-19191ea425db tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1563 microversion: 2.1 time: 0.168932 May 19 12:25:42.401112 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 462/871] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:42 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:42.585645 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-76a85a3f-f838-48f8-98eb-2db7dd98daa4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:42.586234 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-76a85a3f-f838-48f8-98eb-2db7dd98daa4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:42.594919 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-76a85a3f-f838-48f8-98eb-2db7dd98daa4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:42.595383 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-76a85a3f-f838-48f8-98eb-2db7dd98daa4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:42.599393 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-76a85a3f-f838-48f8-98eb-2db7dd98daa4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:42.599393 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-76a85a3f-f838-48f8-98eb-2db7dd98daa4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:42.794313 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-76a85a3f-f838-48f8-98eb-2db7dd98daa4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:42.794313 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-76a85a3f-f838-48f8-98eb-2db7dd98daa4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:42.795450 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-76a85a3f-f838-48f8-98eb-2db7dd98daa4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:42.795450 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-76a85a3f-f838-48f8-98eb-2db7dd98daa4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1405 microversion: 2.20 time: 0.173046 May 19 12:25:42.795450 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 410/872] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:42 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:43.572842 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2b0f133b-32b4-49c6-aa1d-f76551fcb8ee tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1373565915", "imageRef": "962252c6-9c2c-4b81-bdb7-f6d317bada3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "66d32a70-5928-448a-8e67-919eb5765bfb"}], "security_groups": [{"name": "tempest-securitygroup--849112086"}], "key_name": "tempest-keypair-884044206", "user_data": "}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:43.579489 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:43.582214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=8 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:43.682090 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-2b0f133b-32b4-49c6-aa1d-f76551fcb8ee tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] validate_networks() for [('66d32a70-5928-448a-8e67-919eb5765bfb', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:25:43.805607 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b8091618-bca7-4790-b57f-5a67bfd1eb9e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:43.806206 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-b8091618-bca7-4790-b57f-5a67bfd1eb9e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:43.813429 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b8091618-bca7-4790-b57f-5a67bfd1eb9e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:43.814145 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b8091618-bca7-4790-b57f-5a67bfd1eb9e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:43.815611 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b8091618-bca7-4790-b57f-5a67bfd1eb9e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:43.816277 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b8091618-bca7-4790-b57f-5a67bfd1eb9e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:44.076028 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b8091618-bca7-4790-b57f-5a67bfd1eb9e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:44.084785 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b8091618-bca7-4790-b57f-5a67bfd1eb9e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:44.086300 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b8091618-bca7-4790-b57f-5a67bfd1eb9e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:44.087417 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b8091618-bca7-4790-b57f-5a67bfd1eb9e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1405 microversion: 2.20 time: 0.285858 May 19 12:25:44.087995 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 411/873] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:43 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1405 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:25:44.150456 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-2b0f133b-32b4-49c6-aa1d-f76551fcb8ee tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:25:44.150890 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-2b0f133b-32b4-49c6-aa1d-f76551fcb8ee tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:25:44.151374 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-2b0f133b-32b4-49c6-aa1d-f76551fcb8ee tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:25:44.151805 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-2b0f133b-32b4-49c6-aa1d-f76551fcb8ee tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:25:44.152220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-2b0f133b-32b4-49c6-aa1d-f76551fcb8ee tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:25:44.161929 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2b0f133b-32b4-49c6-aa1d-f76551fcb8ee tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:44.164524 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2b0f133b-32b4-49c6-aa1d-f76551fcb8ee tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:44.164524 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2b0f133b-32b4-49c6-aa1d-f76551fcb8ee tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:44.164524 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2b0f133b-32b4-49c6-aa1d-f76551fcb8ee tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:44.181669 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-2b0f133b-32b4-49c6-aa1d-f76551fcb8ee tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Getting quotas for project 9eafee25cfb14ca2bd5c10fe41a01644. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:25:44.185730 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-2b0f133b-32b4-49c6-aa1d-f76551fcb8ee tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Getting quotas for user 9d762cce00ae4e468c358b0437f35deb and project 9eafee25cfb14ca2bd5c10fe41a01644. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:25:44.197039 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2b0f133b-32b4-49c6-aa1d-f76551fcb8ee tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:25:44.199383 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2b0f133b-32b4-49c6-aa1d-f76551fcb8ee tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962252c6-9c2c-4b81-bdb7-f6d317bada3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:25:44.371636 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2b0f133b-32b4-49c6-aa1d-f76551fcb8ee tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.803231 May 19 12:25:44.372947 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 463/874] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:25:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:25:44.383477 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6ae5e0e0-d8e7-43f9-ab8b-1d61558373a6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:44.384132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6ae5e0e0-d8e7-43f9-ab8b-1d61558373a6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:44.446192 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6ae5e0e0-d8e7-43f9-ab8b-1d61558373a6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:44.453375 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6ae5e0e0-d8e7-43f9-ab8b-1d61558373a6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1237 microversion: 2.1 time: 0.074195 May 19 12:25:44.453960 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 412/875] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:44 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:45.110147 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5db81814-3693-4ea8-9d08-e9319c940d51 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:45.112230 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5db81814-3693-4ea8-9d08-e9319c940d51 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:45.124656 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5db81814-3693-4ea8-9d08-e9319c940d51 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:45.125573 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5db81814-3693-4ea8-9d08-e9319c940d51 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:45.127077 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5db81814-3693-4ea8-9d08-e9319c940d51 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:45.128022 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5db81814-3693-4ea8-9d08-e9319c940d51 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:45.281911 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5db81814-3693-4ea8-9d08-e9319c940d51 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:45.290993 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5db81814-3693-4ea8-9d08-e9319c940d51 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:45.292543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5db81814-3693-4ea8-9d08-e9319c940d51 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:45.293651 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5db81814-3693-4ea8-9d08-e9319c940d51 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1405 microversion: 2.20 time: 0.191338 May 19 12:25:45.294207 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 464/876] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:45 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:45.471278 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c9e9892d-22c2-4fe8-ab19-285e5ee8a404 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:45.471954 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c9e9892d-22c2-4fe8-ab19-285e5ee8a404 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:45.478543 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c9e9892d-22c2-4fe8-ab19-285e5ee8a404 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:45.479079 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c9e9892d-22c2-4fe8-ab19-285e5ee8a404 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:45.479845 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c9e9892d-22c2-4fe8-ab19-285e5ee8a404 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:45.480292 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c9e9892d-22c2-4fe8-ab19-285e5ee8a404 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:45.546197 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c9e9892d-22c2-4fe8-ab19-285e5ee8a404 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:45.554071 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c9e9892d-22c2-4fe8-ab19-285e5ee8a404 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1241 microversion: 2.1 time: 0.087237 May 19 12:25:45.557987 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 413/877] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:45 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:46.313466 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-985bf884-0247-437b-89e4-19a6952e3a72 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:46.314424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-985bf884-0247-437b-89e4-19a6952e3a72 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:46.321172 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-985bf884-0247-437b-89e4-19a6952e3a72 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:46.321699 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-985bf884-0247-437b-89e4-19a6952e3a72 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:46.322481 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-985bf884-0247-437b-89e4-19a6952e3a72 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:46.322921 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-985bf884-0247-437b-89e4-19a6952e3a72 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:46.466920 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-985bf884-0247-437b-89e4-19a6952e3a72 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:46.476454 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-985bf884-0247-437b-89e4-19a6952e3a72 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:46.478184 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-985bf884-0247-437b-89e4-19a6952e3a72 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:46.479478 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-985bf884-0247-437b-89e4-19a6952e3a72 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1405 microversion: 2.20 time: 0.171171 May 19 12:25:46.480058 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 465/878] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:46 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:46.489783 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-c299c7c2-61af-4175-bed5-d00b908bd789 req-f111f4c1-4232-45dd-a412-19888c207dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315fa402-5c50-4d9d-bfba-b2e39a9133ec", "name": "network-vif-plugged", "status": "completed", "tag": "60a88c1e-75f6-4fbf-9da2-da492fbaa3ed"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:46.500331 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-c299c7c2-61af-4175-bed5-d00b908bd789 req-f111f4c1-4232-45dd-a412-19888c207dcf service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:46.500779 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-c299c7c2-61af-4175-bed5-d00b908bd789 req-f111f4c1-4232-45dd-a412-19888c207dcf service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:46.514600 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-c299c7c2-61af-4175-bed5-d00b908bd789 req-f111f4c1-4232-45dd-a412-19888c207dcf service nova] Creating event network-vif-plugged:60a88c1e-75f6-4fbf-9da2-da492fbaa3ed for instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec on hv-cinder-80475 May 19 12:25:46.524140 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-c299c7c2-61af-4175-bed5-d00b908bd789 req-f111f4c1-4232-45dd-a412-19888c207dcf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039940 May 19 12:25:46.524140 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 414/879] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:46.571289 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b287200e-2378-4417-96b0-fda2022a21b3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:46.571843 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b287200e-2378-4417-96b0-fda2022a21b3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:46.578266 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b287200e-2378-4417-96b0-fda2022a21b3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:46.578720 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b287200e-2378-4417-96b0-fda2022a21b3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:46.579600 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b287200e-2378-4417-96b0-fda2022a21b3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:46.581074 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b287200e-2378-4417-96b0-fda2022a21b3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:46.646513 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b287200e-2378-4417-96b0-fda2022a21b3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:46.654269 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b287200e-2378-4417-96b0-fda2022a21b3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1233 microversion: 2.1 time: 0.086987 May 19 12:25:46.654854 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 466/880] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:46 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1233 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:47.506301 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-09cd6f30-841c-47ab-93a2-9486090794eb tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:47.506999 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-09cd6f30-841c-47ab-93a2-9486090794eb tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:47.513603 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-09cd6f30-841c-47ab-93a2-9486090794eb tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:47.514011 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-09cd6f30-841c-47ab-93a2-9486090794eb tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:47.515623 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-09cd6f30-841c-47ab-93a2-9486090794eb tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:47.515623 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-09cd6f30-841c-47ab-93a2-9486090794eb tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:47.652465 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-09cd6f30-841c-47ab-93a2-9486090794eb tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:47.661156 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-09cd6f30-841c-47ab-93a2-9486090794eb tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:47.662656 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-09cd6f30-841c-47ab-93a2-9486090794eb tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:47.663761 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-09cd6f30-841c-47ab-93a2-9486090794eb tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1405 microversion: 2.20 time: 0.162571 May 19 12:25:47.664338 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 415/881] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:47 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:47.671802 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d51dc1cd-d7b5-4b62-aa5f-4ca30a32e8b6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:47.672502 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d51dc1cd-d7b5-4b62-aa5f-4ca30a32e8b6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:47.679376 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d51dc1cd-d7b5-4b62-aa5f-4ca30a32e8b6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:47.679850 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d51dc1cd-d7b5-4b62-aa5f-4ca30a32e8b6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:47.680616 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d51dc1cd-d7b5-4b62-aa5f-4ca30a32e8b6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:47.681053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d51dc1cd-d7b5-4b62-aa5f-4ca30a32e8b6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:47.743205 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d51dc1cd-d7b5-4b62-aa5f-4ca30a32e8b6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:47.750663 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d51dc1cd-d7b5-4b62-aa5f-4ca30a32e8b6 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1289 microversion: 2.1 time: 0.082702 May 19 12:25:47.751224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 467/882] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:47 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1289 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:48.686072 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a4a7dbc2-1296-4cfc-b32f-e0c7bbeae949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:48.687284 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a4a7dbc2-1296-4cfc-b32f-e0c7bbeae949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:48.699255 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a4a7dbc2-1296-4cfc-b32f-e0c7bbeae949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:48.700168 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a4a7dbc2-1296-4cfc-b32f-e0c7bbeae949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:48.701327 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a4a7dbc2-1296-4cfc-b32f-e0c7bbeae949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:48.702421 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a4a7dbc2-1296-4cfc-b32f-e0c7bbeae949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:48.769345 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6a8dd6fc-0db5-49fe-8a6a-1ef95c9f4ba4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:48.770961 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6a8dd6fc-0db5-49fe-8a6a-1ef95c9f4ba4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:48.778366 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a8dd6fc-0db5-49fe-8a6a-1ef95c9f4ba4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:48.779091 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a8dd6fc-0db5-49fe-8a6a-1ef95c9f4ba4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:48.780175 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a8dd6fc-0db5-49fe-8a6a-1ef95c9f4ba4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:48.780645 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a8dd6fc-0db5-49fe-8a6a-1ef95c9f4ba4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:48.862757 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6a8dd6fc-0db5-49fe-8a6a-1ef95c9f4ba4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:48.870434 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6a8dd6fc-0db5-49fe-8a6a-1ef95c9f4ba4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1297 microversion: 2.1 time: 0.105089 May 19 12:25:48.871002 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 468/883] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:48 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1297 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:48.895169 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a4a7dbc2-1296-4cfc-b32f-e0c7bbeae949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:48.910074 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a4a7dbc2-1296-4cfc-b32f-e0c7bbeae949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:48.910074 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a4a7dbc2-1296-4cfc-b32f-e0c7bbeae949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:48.910074 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a4a7dbc2-1296-4cfc-b32f-e0c7bbeae949 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1405 microversion: 2.20 time: 0.227047 May 19 12:25:48.910475 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 416/884] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:48 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:49.888957 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1bae69f0-52fc-4a3d-a0f0-7a9bfcef004a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:49.889574 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1bae69f0-52fc-4a3d-a0f0-7a9bfcef004a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:49.897229 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1bae69f0-52fc-4a3d-a0f0-7a9bfcef004a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:49.897691 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1bae69f0-52fc-4a3d-a0f0-7a9bfcef004a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:49.900196 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1bae69f0-52fc-4a3d-a0f0-7a9bfcef004a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:49.900196 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1bae69f0-52fc-4a3d-a0f0-7a9bfcef004a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:49.928650 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-2c5923c0-580b-4cc1-bc94-902121f6854b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:49.929343 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-2c5923c0-580b-4cc1-bc94-902121f6854b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:49.947219 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2c5923c0-580b-4cc1-bc94-902121f6854b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:49.947690 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2c5923c0-580b-4cc1-bc94-902121f6854b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:49.948687 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2c5923c0-580b-4cc1-bc94-902121f6854b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:49.949431 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2c5923c0-580b-4cc1-bc94-902121f6854b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:50.119040 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1bae69f0-52fc-4a3d-a0f0-7a9bfcef004a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:50.129157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1bae69f0-52fc-4a3d-a0f0-7a9bfcef004a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1362 microversion: 2.1 time: 0.244472 May 19 12:25:50.138720 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 469/885] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:49 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:50.147654 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-2c5923c0-580b-4cc1-bc94-902121f6854b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:50.156230 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-2c5923c0-580b-4cc1-bc94-902121f6854b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:50.157854 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-2c5923c0-580b-4cc1-bc94-902121f6854b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:50.160071 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-2c5923c0-580b-4cc1-bc94-902121f6854b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1597 microversion: 2.20 time: 0.237616 May 19 12:25:50.166652 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 417/886] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:25:49 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1597 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:50.183192 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7b659923-bfbc-4d13-a7fb-4545477b9056 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:50.183712 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7b659923-bfbc-4d13-a7fb-4545477b9056 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:50.190563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7b659923-bfbc-4d13-a7fb-4545477b9056 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:50.191018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7b659923-bfbc-4d13-a7fb-4545477b9056 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:50.191813 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7b659923-bfbc-4d13-a7fb-4545477b9056 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:50.192268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7b659923-bfbc-4d13-a7fb-4545477b9056 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:50.277776 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7b659923-bfbc-4d13-a7fb-4545477b9056 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098526 May 19 12:25:50.278457 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 470/887] 10.222.0.23 () {60 vars in 1315 bytes} [Thu May 19 12:25:50 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:25:51.142166 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-6764711b-785f-41c7-b565-ece5bbef2295 req-9dddb06d-593f-4795-ba67-711fd5e1e8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3447311f-fa45-4fe9-bdf8-d9b88c27356f", "tag": "96b7e59a-40c2-4b31-bcdf-f5bd068dca42"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:51.147041 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6364271e-f4f7-433b-a481-e409d0f9d7d8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:51.149371 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6364271e-f4f7-433b-a481-e409d0f9d7d8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:51.161037 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-6764711b-785f-41c7-b565-ece5bbef2295 req-9dddb06d-593f-4795-ba67-711fd5e1e8f9 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:51.165034 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-6764711b-785f-41c7-b565-ece5bbef2295 req-9dddb06d-593f-4795-ba67-711fd5e1e8f9 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:51.167346 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6364271e-f4f7-433b-a481-e409d0f9d7d8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:51.172324 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6364271e-f4f7-433b-a481-e409d0f9d7d8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:51.173256 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6364271e-f4f7-433b-a481-e409d0f9d7d8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:51.174307 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6364271e-f4f7-433b-a481-e409d0f9d7d8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:51.177292 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-6764711b-785f-41c7-b565-ece5bbef2295 req-9dddb06d-593f-4795-ba67-711fd5e1e8f9 service nova] Creating event network-changed:96b7e59a-40c2-4b31-bcdf-f5bd068dca42 for instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f on hv-cinder-80475 May 19 12:25:51.184354 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-6764711b-785f-41c7-b565-ece5bbef2295 req-9dddb06d-593f-4795-ba67-711fd5e1e8f9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046243 May 19 12:25:51.188010 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 418/888] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:51.434382 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6364271e-f4f7-433b-a481-e409d0f9d7d8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:51.453026 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6364271e-f4f7-433b-a481-e409d0f9d7d8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1362 microversion: 2.1 time: 0.310081 May 19 12:25:51.463468 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 471/889] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:51 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:51.728183 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-739e078a-e583-4f48-94f9-14d985c645c8 req-35721717-f2f9-4711-af19-66cc093a35c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "315fa402-5c50-4d9d-bfba-b2e39a9133ec", "tag": "60a88c1e-75f6-4fbf-9da2-da492fbaa3ed"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:51.736922 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-739e078a-e583-4f48-94f9-14d985c645c8 req-35721717-f2f9-4711-af19-66cc093a35c8 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:51.737369 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-739e078a-e583-4f48-94f9-14d985c645c8 req-35721717-f2f9-4711-af19-66cc093a35c8 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:51.748507 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-739e078a-e583-4f48-94f9-14d985c645c8 req-35721717-f2f9-4711-af19-66cc093a35c8 service nova] Creating event network-changed:60a88c1e-75f6-4fbf-9da2-da492fbaa3ed for instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec on hv-cinder-80475 May 19 12:25:51.754290 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-739e078a-e583-4f48-94f9-14d985c645c8 req-35721717-f2f9-4711-af19-66cc093a35c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031257 May 19 12:25:51.755076 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 419/890] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:52.471371 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fa89b7c1-7c70-4e5a-96ba-2f39ae023da5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:52.472144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-fa89b7c1-7c70-4e5a-96ba-2f39ae023da5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:52.478686 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fa89b7c1-7c70-4e5a-96ba-2f39ae023da5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:52.479134 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fa89b7c1-7c70-4e5a-96ba-2f39ae023da5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:52.479954 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fa89b7c1-7c70-4e5a-96ba-2f39ae023da5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:52.480390 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fa89b7c1-7c70-4e5a-96ba-2f39ae023da5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:52.616891 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fa89b7c1-7c70-4e5a-96ba-2f39ae023da5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:52.620319 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:52.624908 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fa89b7c1-7c70-4e5a-96ba-2f39ae023da5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1362 microversion: 2.1 time: 0.158205 May 19 12:25:52.625491 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 472/891] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:52 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:53.643884 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-fe504e83-d25a-416b-b24f-6eebf011871a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:53.644712 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-fe504e83-d25a-416b-b24f-6eebf011871a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:53.651109 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fe504e83-d25a-416b-b24f-6eebf011871a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:53.651643 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fe504e83-d25a-416b-b24f-6eebf011871a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:53.652470 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fe504e83-d25a-416b-b24f-6eebf011871a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:53.652991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fe504e83-d25a-416b-b24f-6eebf011871a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:53.789845 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-fe504e83-d25a-416b-b24f-6eebf011871a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:53.797844 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-fe504e83-d25a-416b-b24f-6eebf011871a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1362 microversion: 2.1 time: 0.159376 May 19 12:25:53.798426 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 420/892] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:53 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:54.815862 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-496731ac-d873-4f7a-a5ed-f1c93ab59211 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:54.816511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-496731ac-d873-4f7a-a5ed-f1c93ab59211 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:54.819495 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:54.820186 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=6 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:54.825206 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-496731ac-d873-4f7a-a5ed-f1c93ab59211 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:54.825592 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-496731ac-d873-4f7a-a5ed-f1c93ab59211 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:54.826356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-496731ac-d873-4f7a-a5ed-f1c93ab59211 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:54.826786 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-496731ac-d873-4f7a-a5ed-f1c93ab59211 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:54.967976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-496731ac-d873-4f7a-a5ed-f1c93ab59211 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:54.978162 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-496731ac-d873-4f7a-a5ed-f1c93ab59211 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1362 microversion: 2.1 time: 0.166293 May 19 12:25:54.988223 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 473/893] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:54 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:55.995823 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0dffe35e-284c-4733-92aa-d68c30f86e39 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:55.996444 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0dffe35e-284c-4733-92aa-d68c30f86e39 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:55.998479 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=6 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:56.006823 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0dffe35e-284c-4733-92aa-d68c30f86e39 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:56.007276 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0dffe35e-284c-4733-92aa-d68c30f86e39 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:56.008106 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0dffe35e-284c-4733-92aa-d68c30f86e39 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:56.008549 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0dffe35e-284c-4733-92aa-d68c30f86e39 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:56.145975 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-0dffe35e-284c-4733-92aa-d68c30f86e39 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:56.149151 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0dffe35e-284c-4733-92aa-d68c30f86e39 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1362 microversion: 2.1 time: 0.157266 May 19 12:25:56.149789 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 421/894] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:55 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:56.569728 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-87cf6e74-75b6-4f91-af7a-5374224825d5 req-6d0298cf-0247-457d-9d63-5373a8447557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3447311f-fa45-4fe9-bdf8-d9b88c27356f", "name": "network-vif-plugged", "status": "completed", "tag": "96b7e59a-40c2-4b31-bcdf-f5bd068dca42"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:56.579171 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-87cf6e74-75b6-4f91-af7a-5374224825d5 req-6d0298cf-0247-457d-9d63-5373a8447557 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:56.580245 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-87cf6e74-75b6-4f91-af7a-5374224825d5 req-6d0298cf-0247-457d-9d63-5373a8447557 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:56.592097 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-87cf6e74-75b6-4f91-af7a-5374224825d5 req-6d0298cf-0247-457d-9d63-5373a8447557 service nova] Creating event network-vif-plugged:96b7e59a-40c2-4b31-bcdf-f5bd068dca42 for instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f on hv-cinder-80475 May 19 12:25:56.598584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-87cf6e74-75b6-4f91-af7a-5374224825d5 req-6d0298cf-0247-457d-9d63-5373a8447557 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032858 May 19 12:25:56.599859 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 474/895] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:57.167535 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6d20dac9-956f-4e2f-89d6-b6ac8aab4ee5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:57.168261 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6d20dac9-956f-4e2f-89d6-b6ac8aab4ee5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:57.175862 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6d20dac9-956f-4e2f-89d6-b6ac8aab4ee5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:57.176317 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6d20dac9-956f-4e2f-89d6-b6ac8aab4ee5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:57.177104 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6d20dac9-956f-4e2f-89d6-b6ac8aab4ee5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:57.177544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6d20dac9-956f-4e2f-89d6-b6ac8aab4ee5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:57.356306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6d20dac9-956f-4e2f-89d6-b6ac8aab4ee5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:57.364710 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6d20dac9-956f-4e2f-89d6-b6ac8aab4ee5 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1362 microversion: 2.1 time: 0.201651 May 19 12:25:57.365278 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 422/896] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:57 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:58.382982 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6ebeb4ef-b7b8-4a3e-a645-5f9f59d40d85 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:58.383694 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6ebeb4ef-b7b8-4a3e-a645-5f9f59d40d85 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:58.390023 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6ebeb4ef-b7b8-4a3e-a645-5f9f59d40d85 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:58.390478 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6ebeb4ef-b7b8-4a3e-a645-5f9f59d40d85 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:58.391276 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6ebeb4ef-b7b8-4a3e-a645-5f9f59d40d85 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:58.391722 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6ebeb4ef-b7b8-4a3e-a645-5f9f59d40d85 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:58.563816 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6ebeb4ef-b7b8-4a3e-a645-5f9f59d40d85 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:58.571546 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6ebeb4ef-b7b8-4a3e-a645-5f9f59d40d85 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1362 microversion: 2.1 time: 0.193320 May 19 12:25:58.572156 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 475/897] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:58 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:59.588091 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b09181ff-ccc9-4789-91ab-f666608ecf78 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:59.588706 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-b09181ff-ccc9-4789-91ab-f666608ecf78 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:59.597471 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b09181ff-ccc9-4789-91ab-f666608ecf78 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:59.597861 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b09181ff-ccc9-4789-91ab-f666608ecf78 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:59.598615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b09181ff-ccc9-4789-91ab-f666608ecf78 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:59.599024 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b09181ff-ccc9-4789-91ab-f666608ecf78 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:59.737491 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b09181ff-ccc9-4789-91ab-f666608ecf78 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:59.744958 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b09181ff-ccc9-4789-91ab-f666608ecf78 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1548 microversion: 2.1 time: 0.160754 May 19 12:25:59.745515 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 423/898] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:25:59 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:59.761108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5c844512-e65d-433f-9063-0ba74195098b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:59.761605 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5c844512-e65d-433f-9063-0ba74195098b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:59.764024 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:59.769673 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c844512-e65d-433f-9063-0ba74195098b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:59.770131 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c844512-e65d-433f-9063-0ba74195098b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:59.770899 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c844512-e65d-433f-9063-0ba74195098b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:59.771335 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c844512-e65d-433f-9063-0ba74195098b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:59.856511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5c844512-e65d-433f-9063-0ba74195098b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099089 May 19 12:25:59.857107 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 476/899] 10.222.0.23 () {58 vars in 1274 bytes} [Thu May 19 12:25:59 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:01.094517 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-38b69b6b-f310-46a2-8be9-ccaf59852d9d req-0f9afd13-5979-4de3-8cf0-d7e54ebfdf7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3447311f-fa45-4fe9-bdf8-d9b88c27356f", "tag": "96b7e59a-40c2-4b31-bcdf-f5bd068dca42"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:26:01.105927 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-38b69b6b-f310-46a2-8be9-ccaf59852d9d req-0f9afd13-5979-4de3-8cf0-d7e54ebfdf7c service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:01.106301 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-38b69b6b-f310-46a2-8be9-ccaf59852d9d req-0f9afd13-5979-4de3-8cf0-d7e54ebfdf7c service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:01.118316 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-38b69b6b-f310-46a2-8be9-ccaf59852d9d req-0f9afd13-5979-4de3-8cf0-d7e54ebfdf7c service nova] Creating event network-changed:96b7e59a-40c2-4b31-bcdf-f5bd068dca42 for instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f on hv-cinder-80475 May 19 12:26:01.124200 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-38b69b6b-f310-46a2-8be9-ccaf59852d9d req-0f9afd13-5979-4de3-8cf0-d7e54ebfdf7c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033242 May 19 12:26:01.125431 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 424/900] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:06.533213 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-08cd55f1-8bd4-467d-929b-29b870aa56e0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1317364270"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:26:06.533893 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-08cd55f1-8bd4-467d-929b-29b870aa56e0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:06.540616 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-08cd55f1-8bd4-467d-929b-29b870aa56e0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:06.541065 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-08cd55f1-8bd4-467d-929b-29b870aa56e0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:06.541835 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-08cd55f1-8bd4-467d-929b-29b870aa56e0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:06.542269 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-08cd55f1-8bd4-467d-929b-29b870aa56e0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:06.677360 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.network.security_group_api [None req-08cd55f1-8bd4-467d-929b-29b870aa56e0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Removing security group 6306b95e-e9fa-4ca1-9895-c0672ccfb0cb from port e5cc5a87-b36f-4dee-a908-9a890b9f1ed7 May 19 12:26:07.138997 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-08cd55f1-8bd4-467d-929b-29b870aa56e0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "POST /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/action" status: 202 len: 0 microversion: 2.1 time: 0.610466 May 19 12:26:07.139627 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 477/901] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 19 12:26:06 2022] POST /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:26:07.150883 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-5cca6b5c-c1c6-4bc2-adcf-3503a99fde26 req-3393a67e-db26-4912-8ed4-f1de724a2ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7da8d619-7d0b-4cfe-bf0b-f42f7d304db3", "tag": "e5cc5a87-b36f-4dee-a908-9a890b9f1ed7"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:26:07.160889 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:07.164518 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-5cca6b5c-c1c6-4bc2-adcf-3503a99fde26 req-3393a67e-db26-4912-8ed4-f1de724a2ac3 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:07.165241 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-5cca6b5c-c1c6-4bc2-adcf-3503a99fde26 req-3393a67e-db26-4912-8ed4-f1de724a2ac3 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:07.182801 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-5cca6b5c-c1c6-4bc2-adcf-3503a99fde26 req-3393a67e-db26-4912-8ed4-f1de724a2ac3 service nova] Creating event network-changed:e5cc5a87-b36f-4dee-a908-9a890b9f1ed7 for instance 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 on hv-cinder-80475 May 19 12:26:07.188417 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-5cca6b5c-c1c6-4bc2-adcf-3503a99fde26 req-3393a67e-db26-4912-8ed4-f1de724a2ac3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043473 May 19 12:26:07.191084 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 425/902] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:08.411355 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-df7a8993-4be4-4072-b77a-4858227abb37 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:08.412532 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-df7a8993-4be4-4072-b77a-4858227abb37 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:08.418932 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df7a8993-4be4-4072-b77a-4858227abb37 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:08.419387 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df7a8993-4be4-4072-b77a-4858227abb37 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:08.420199 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df7a8993-4be4-4072-b77a-4858227abb37 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:08.420638 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df7a8993-4be4-4072-b77a-4858227abb37 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:08.504358 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-df7a8993-4be4-4072-b77a-4858227abb37 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lazy-loading 'services' on Instance uuid 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:26:08.755636 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-df7a8993-4be4-4072-b77a-4858227abb37 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments/a3d7810a-9c45-495e-a7c7-b061e0642dd7" status: 202 len: 0 microversion: 2.1 time: 0.349965 May 19 12:26:08.760672 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 478/903] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 19 12:26:08 2022] DELETE /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments/a3d7810a-9c45-495e-a7c7-b061e0642dd7 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:26:08.766092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-fc51ef2d-6563-4d80-ba19-b0dba2924a1c tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:08.767921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-fc51ef2d-6563-4d80-ba19-b0dba2924a1c tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:08.781338 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fc51ef2d-6563-4d80-ba19-b0dba2924a1c tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:08.781978 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fc51ef2d-6563-4d80-ba19-b0dba2924a1c tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:08.782859 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fc51ef2d-6563-4d80-ba19-b0dba2924a1c tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:08.783296 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fc51ef2d-6563-4d80-ba19-b0dba2924a1c tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:08.822072 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-fc51ef2d-6563-4d80-ba19-b0dba2924a1c tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060321 May 19 12:26:08.823055 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 426/904] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:26:08 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:09.207553 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-9d140b8d-56b0-4a21-8fc5-83bde38c0d6a req-d0eb9b18-c102-42e1-a8c2-79517162d854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7da8d619-7d0b-4cfe-bf0b-f42f7d304db3", "tag": "e5cc5a87-b36f-4dee-a908-9a890b9f1ed7"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:26:09.216056 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-9d140b8d-56b0-4a21-8fc5-83bde38c0d6a req-d0eb9b18-c102-42e1-a8c2-79517162d854 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:09.216494 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-9d140b8d-56b0-4a21-8fc5-83bde38c0d6a req-d0eb9b18-c102-42e1-a8c2-79517162d854 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:09.228725 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-9d140b8d-56b0-4a21-8fc5-83bde38c0d6a req-d0eb9b18-c102-42e1-a8c2-79517162d854 service nova] Creating event network-changed:e5cc5a87-b36f-4dee-a908-9a890b9f1ed7 for instance 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 on hv-cinder-80475 May 19 12:26:09.233744 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-9d140b8d-56b0-4a21-8fc5-83bde38c0d6a req-d0eb9b18-c102-42e1-a8c2-79517162d854 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031314 May 19 12:26:09.237979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 479/905] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:09.835375 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a9f6138b-b011-4b91-8b3d-c8cda869f0a7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:09.836403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a9f6138b-b011-4b91-8b3d-c8cda869f0a7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:09.843768 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a9f6138b-b011-4b91-8b3d-c8cda869f0a7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:09.844368 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a9f6138b-b011-4b91-8b3d-c8cda869f0a7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:09.845771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a9f6138b-b011-4b91-8b3d-c8cda869f0a7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:09.846220 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a9f6138b-b011-4b91-8b3d-c8cda869f0a7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:09.877761 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a9f6138b-b011-4b91-8b3d-c8cda869f0a7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046819 May 19 12:26:09.878266 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 427/906] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:26:09 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:26:10.889808 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c370fcd5-8903-4d92-8c2c-9cf4290f5a4c tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:10.890825 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c370fcd5-8903-4d92-8c2c-9cf4290f5a4c tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:10.897701 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c370fcd5-8903-4d92-8c2c-9cf4290f5a4c tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:10.898156 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c370fcd5-8903-4d92-8c2c-9cf4290f5a4c tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:10.898917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c370fcd5-8903-4d92-8c2c-9cf4290f5a4c tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:10.899354 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c370fcd5-8903-4d92-8c2c-9cf4290f5a4c tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:10.928797 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c370fcd5-8903-4d92-8c2c-9cf4290f5a4c tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043214 May 19 12:26:10.929357 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 480/907] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:26:10 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:11.940496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f1bd8dc2-1efe-4a2c-bae3-a6c980b4e0c4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:11.941455 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f1bd8dc2-1efe-4a2c-bae3-a6c980b4e0c4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:11.948640 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f1bd8dc2-1efe-4a2c-bae3-a6c980b4e0c4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:11.949099 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f1bd8dc2-1efe-4a2c-bae3-a6c980b4e0c4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:11.949879 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f1bd8dc2-1efe-4a2c-bae3-a6c980b4e0c4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:11.950320 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f1bd8dc2-1efe-4a2c-bae3-a6c980b4e0c4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:11.981303 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f1bd8dc2-1efe-4a2c-bae3-a6c980b4e0c4 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045251 May 19 12:26:11.981901 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 428/908] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:26:11 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:12.993247 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d74b3152-7b1d-4a58-9d4a-a29475932cba tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:12.994172 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d74b3152-7b1d-4a58-9d4a-a29475932cba tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:13.000749 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d74b3152-7b1d-4a58-9d4a-a29475932cba tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:13.001205 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d74b3152-7b1d-4a58-9d4a-a29475932cba tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:13.002140 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d74b3152-7b1d-4a58-9d4a-a29475932cba tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:13.002581 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d74b3152-7b1d-4a58-9d4a-a29475932cba tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:13.031577 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d74b3152-7b1d-4a58-9d4a-a29475932cba tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042292 May 19 12:26:13.032174 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 481/909] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:26:12 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:14.044644 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-bac3c0e7-f57c-4139-82d6-a3f13526b7f7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:14.045577 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-bac3c0e7-f57c-4139-82d6-a3f13526b7f7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:14.053297 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bac3c0e7-f57c-4139-82d6-a3f13526b7f7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:14.053751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bac3c0e7-f57c-4139-82d6-a3f13526b7f7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:14.054544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bac3c0e7-f57c-4139-82d6-a3f13526b7f7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:14.054988 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bac3c0e7-f57c-4139-82d6-a3f13526b7f7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:14.057830 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=89 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:14.087223 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-bac3c0e7-f57c-4139-82d6-a3f13526b7f7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046417 May 19 12:26:14.087807 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 429/910] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:26:14 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:15.098798 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-86764fd4-8f71-4503-94bd-fe5b7bf54fd5 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:15.099720 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-86764fd4-8f71-4503-94bd-fe5b7bf54fd5 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:15.106262 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-86764fd4-8f71-4503-94bd-fe5b7bf54fd5 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:15.106709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-86764fd4-8f71-4503-94bd-fe5b7bf54fd5 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:15.107462 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-86764fd4-8f71-4503-94bd-fe5b7bf54fd5 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:15.107927 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-86764fd4-8f71-4503-94bd-fe5b7bf54fd5 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:15.138267 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-86764fd4-8f71-4503-94bd-fe5b7bf54fd5 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043546 May 19 12:26:15.138810 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 482/911] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:26:15 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:16.151416 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0753b08f-4b16-4ade-9c13-7963e825ffee tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:16.152360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0753b08f-4b16-4ade-9c13-7963e825ffee tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:16.158891 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0753b08f-4b16-4ade-9c13-7963e825ffee tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:16.159337 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0753b08f-4b16-4ade-9c13-7963e825ffee tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:16.160972 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0753b08f-4b16-4ade-9c13-7963e825ffee tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:16.161405 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0753b08f-4b16-4ade-9c13-7963e825ffee tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:16.190126 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0753b08f-4b16-4ade-9c13-7963e825ffee tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042987 May 19 12:26:16.190624 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 430/912] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:26:16 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 12:26:16.200771 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-df2feac1-4d92-47c5-a13f-79051cb620a0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:16.201274 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-df2feac1-4d92-47c5-a13f-79051cb620a0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:16.208487 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df2feac1-4d92-47c5-a13f-79051cb620a0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:16.208938 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df2feac1-4d92-47c5-a13f-79051cb620a0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:16.209800 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df2feac1-4d92-47c5-a13f-79051cb620a0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:16.210270 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df2feac1-4d92-47c5-a13f-79051cb620a0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:16.288646 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-df2feac1-4d92-47c5-a13f-79051cb620a0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] HTTP exception thrown: Instance 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 is not attached to volume a3d7810a-9c45-495e-a7c7-b061e0642dd7 May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-df2feac1-4d92-47c5-a13f-79051cb620a0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Request method failure captured: May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: DELETE /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments/a3d7810a-9c45-495e-a7c7-b061e0642dd7 HTTP/1.1 May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjZMgNY8cAXmEtRaoc_au8k6ryIqtcYOUWxFRNKvC-AAYBzsxca14r97AsRSEJLDlEO5lVn1Fyd208W1doe7TFdaap5bXwVVG5_1EueAW5n39A3FnvmHl5vpxdTjBKLE0LJiqCm9GIdsHQOWVhu8c1PXbKVBBFnQiwvBv6toNtF3WH4 May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 37c1366ee71c446b9ec6fa532391b789 May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-TestMinimumBasicScenario-279966415 May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:26:16.296515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:26:16.298109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_37c1366ee71c446b9ec6fa532391b789"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/37c1366ee71c446b9ec6fa532391b789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/37c1366ee71c446b9ec6fa532391b789"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/37c1366ee71c446b9ec6fa532391b789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:26:16.298109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-TestMinimumBasicScenario-279966415 May 19 12:26:16.298109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 37c1366ee71c446b9ec6fa532391b789 May 19 12:26:16.298109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-TestMinimumBasicScenario-279966415 May 19 12:26:16.298109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-TestMinimumBasicScenario-279966415-project May 19 12:26:16.298109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:26:16.298109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:26:16.298109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: d53ee7f4a9b74ce1868715ed0177bf2a May 19 12:26:16.298109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-TestMinimumBasicScenario-279966415-project May 19 12:26:16.298109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:26:16.298109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 is not attached to volume a3d7810a-9c45-495e-a7c7-b061e0642dd7 May 19 12:26:16.299019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'server_id': '7da8d619-7d0b-4cfe-bf0b-f42f7d304db3', 'id': 'a3d7810a-9c45-495e-a7c7-b061e0642dd7'} May 19 12:26:16.299019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:26:16.299019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:16.299019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 19 12:26:16.299019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 19 12:26:16.299019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 12:26:16.299019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 12:26:16.299019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 19 12:26:16.299019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 19 12:26:16.299019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a3d7810a-9c45-495e-a7c7-b061e0642dd7. May 19 12:26:16.299019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:26:16.299019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:16.299019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:26:16.299019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:16.299019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:16.299019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:16.299019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:26:16.299019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:26:16.299019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:26:16.301061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:26:16.301061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 19 12:26:16.301061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 12:26:16.301061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 is not attached to volume a3d7810a-9c45-495e-a7c7-b061e0642dd7 May 19 12:26:16.301061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:26:16.301061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:16.301061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:26:16.301061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:16.301061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:16.301061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:16.301061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:26:16.301061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:26:16.301061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 is not attached to volume a3d7810a-9c45-495e-a7c7-b061e0642dd7 May 19 12:26:16.301061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:26:16.301061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-df2feac1-4d92-47c5-a13f-79051cb620a0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Returning 404 to user: Instance 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 is not attached to volume a3d7810a-9c45-495e-a7c7-b061e0642dd7 {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:26:16.302637 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-df2feac1-4d92-47c5-a13f-79051cb620a0 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments/a3d7810a-9c45-495e-a7c7-b061e0642dd7" status: 404 len: 154 microversion: 2.1 time: 0.101409 May 19 12:26:16.302637 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 483/913] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 19 12:26:16 2022] DELETE /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3/os-volume_attachments/a3d7810a-9c45-495e-a7c7-b061e0642dd7 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:26:17.605660 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-dec5611a-73fb-49ac-8ec4-068254e07088 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:17.606171 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-dec5611a-73fb-49ac-8ec4-068254e07088 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:17.613892 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dec5611a-73fb-49ac-8ec4-068254e07088 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:17.614580 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dec5611a-73fb-49ac-8ec4-068254e07088 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:17.615372 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dec5611a-73fb-49ac-8ec4-068254e07088 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:17.615839 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dec5611a-73fb-49ac-8ec4-068254e07088 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:17.643348 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-dec5611a-73fb-49ac-8ec4-068254e07088 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Going to try to terminate instance {{(pid=117964) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:26:18.031944 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-dec5611a-73fb-49ac-8ec4-068254e07088 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 204 len: 0 microversion: 2.1 time: 0.429758 May 19 12:26:18.032638 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 431/914] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:26:17 2022] DELETE /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 12:26:18.041585 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e947648d-2623-48ca-8c58-22cc583d12e6 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:18.046289 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e947648d-2623-48ca-8c58-22cc583d12e6 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:18.049179 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e947648d-2623-48ca-8c58-22cc583d12e6 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:18.049627 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e947648d-2623-48ca-8c58-22cc583d12e6 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:18.051142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e947648d-2623-48ca-8c58-22cc583d12e6 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:18.051666 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e947648d-2623-48ca-8c58-22cc583d12e6 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:18.192805 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e947648d-2623-48ca-8c58-22cc583d12e6 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:18.200574 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e947648d-2623-48ca-8c58-22cc583d12e6 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1553 microversion: 2.1 time: 0.162758 May 19 12:26:18.201139 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 484/915] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:26:18 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:19.219744 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-fa99c6f5-4e67-453b-a062-51dd2be47ccc tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:19.220509 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-fa99c6f5-4e67-453b-a062-51dd2be47ccc tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:19.228309 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa99c6f5-4e67-453b-a062-51dd2be47ccc tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:19.228763 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa99c6f5-4e67-453b-a062-51dd2be47ccc tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:19.229577 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa99c6f5-4e67-453b-a062-51dd2be47ccc tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:19.230015 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa99c6f5-4e67-453b-a062-51dd2be47ccc tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:19.369868 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-fa99c6f5-4e67-453b-a062-51dd2be47ccc tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:19.377451 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-fa99c6f5-4e67-453b-a062-51dd2be47ccc tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1553 microversion: 2.1 time: 0.162513 May 19 12:26:19.378515 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 432/916] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:26:19 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:20.395457 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ac05e634-a7c3-466d-8641-b035c4ffe917 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:20.396091 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ac05e634-a7c3-466d-8641-b035c4ffe917 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:20.402751 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ac05e634-a7c3-466d-8641-b035c4ffe917 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:20.403210 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ac05e634-a7c3-466d-8641-b035c4ffe917 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:20.404026 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ac05e634-a7c3-466d-8641-b035c4ffe917 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:20.404470 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ac05e634-a7c3-466d-8641-b035c4ffe917 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:20.539304 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ac05e634-a7c3-466d-8641-b035c4ffe917 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:20.547181 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ac05e634-a7c3-466d-8641-b035c4ffe917 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1553 microversion: 2.1 time: 0.155588 May 19 12:26:20.547855 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 485/917] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:26:20 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:21.108974 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-3675e770-cc3e-4798-b703-7e61a646ebca req-fe4467e2-bb02-41f6-91fc-7174c762f431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da8d619-7d0b-4cfe-bf0b-f42f7d304db3", "name": "network-vif-deleted", "tag": "e5cc5a87-b36f-4dee-a908-9a890b9f1ed7"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:26:21.117321 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-3675e770-cc3e-4798-b703-7e61a646ebca req-fe4467e2-bb02-41f6-91fc-7174c762f431 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:21.117762 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-3675e770-cc3e-4798-b703-7e61a646ebca req-fe4467e2-bb02-41f6-91fc-7174c762f431 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:21.129645 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-3675e770-cc3e-4798-b703-7e61a646ebca req-fe4467e2-bb02-41f6-91fc-7174c762f431 service nova] Creating event network-vif-deleted:e5cc5a87-b36f-4dee-a908-9a890b9f1ed7 for instance 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 on hv-cinder-80475 May 19 12:26:21.134628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-3675e770-cc3e-4798-b703-7e61a646ebca req-fe4467e2-bb02-41f6-91fc-7174c762f431 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029859 May 19 12:26:21.135231 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 433/918] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:21.564720 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-afcb0a11-5fcf-47c5-a982-ee36fc5f7a1d tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:21.565346 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-afcb0a11-5fcf-47c5-a982-ee36fc5f7a1d tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:21.572127 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-afcb0a11-5fcf-47c5-a982-ee36fc5f7a1d tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:21.572585 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-afcb0a11-5fcf-47c5-a982-ee36fc5f7a1d tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:21.573374 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-afcb0a11-5fcf-47c5-a982-ee36fc5f7a1d tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:21.573818 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-afcb0a11-5fcf-47c5-a982-ee36fc5f7a1d tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:21.605297 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-afcb0a11-5fcf-47c5-a982-ee36fc5f7a1d tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:21.605784 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-afcb0a11-5fcf-47c5-a982-ee36fc5f7a1d tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:21.606220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-afcb0a11-5fcf-47c5-a982-ee36fc5f7a1d tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lazy-loading 'fault' on Instance uuid 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:26:21.653356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-afcb0a11-5fcf-47c5-a982-ee36fc5f7a1d tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53ee7f4a9b74ce1868715ed0177bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1366ee71c446b9ec6fa532391b789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:21.657365 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-afcb0a11-5fcf-47c5-a982-ee36fc5f7a1d tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 200 len: 1348 microversion: 2.1 time: 0.096601 May 19 12:26:21.657929 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 486/919] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:26:21 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 1348 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:22.677696 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-846e8f4d-18dd-42cc-a3b0-0ea8b331c583 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:22.678470 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-846e8f4d-18dd-42cc-a3b0-0ea8b331c583 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] [instance: 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:22.684929 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-846e8f4d-18dd-42cc-a3b0-0ea8b331c583 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:22.685384 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-846e8f4d-18dd-42cc-a3b0-0ea8b331c583 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:22.686159 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-846e8f4d-18dd-42cc-a3b0-0ea8b331c583 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:22.686649 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-846e8f4d-18dd-42cc-a3b0-0ea8b331c583 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:22.703223 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-846e8f4d-18dd-42cc-a3b0-0ea8b331c583 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] HTTP exception thrown: Instance 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 could not be found. May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-846e8f4d-18dd-42cc-a3b0-0ea8b331c583 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Request method failure captured: May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 HTTP/1.1 May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjZMgNY8cAXmEtRaoc_au8k6ryIqtcYOUWxFRNKvC-AAYBzsxca14r97AsRSEJLDlEO5lVn1Fyd208W1doe7TFdaap5bXwVVG5_1EueAW5n39A3FnvmHl5vpxdTjBKLE0LJiqCm9GIdsHQOWVhu8c1PXbKVBBFnQiwvBv6toNtF3WH4 May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 37c1366ee71c446b9ec6fa532391b789 May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-TestMinimumBasicScenario-279966415 May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:26:22.704906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:26:22.708797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_37c1366ee71c446b9ec6fa532391b789"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/37c1366ee71c446b9ec6fa532391b789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/37c1366ee71c446b9ec6fa532391b789"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/37c1366ee71c446b9ec6fa532391b789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:26:22.708797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-TestMinimumBasicScenario-279966415 May 19 12:26:22.708797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 37c1366ee71c446b9ec6fa532391b789 May 19 12:26:22.708797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-TestMinimumBasicScenario-279966415 May 19 12:26:22.708797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-TestMinimumBasicScenario-279966415-project May 19 12:26:22.708797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:26:22.708797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:26:22.708797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: d53ee7f4a9b74ce1868715ed0177bf2a May 19 12:26:22.708797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-TestMinimumBasicScenario-279966415-project May 19 12:26:22.708797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:26:22.708797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 could not be found. May 19 12:26:22.708797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': '7da8d619-7d0b-4cfe-bf0b-f42f7d304db3'} May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 could not be found. May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:26:22.709751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:26:22.711483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:26:22.711483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:26:22.711483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:26:22.711483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:26:22.711483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:26:22.711483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:26:22.711483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:26:22.711483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 could not be found. May 19 12:26:22.711483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:26:22.711483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:22.711483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:26:22.711483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:22.711483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:22.711483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:22.711483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:26:22.711483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:26:22.711483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 could not be found. May 19 12:26:22.711483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:26:22.712934 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-846e8f4d-18dd-42cc-a3b0-0ea8b331c583 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Returning 404 to user: Instance 7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:26:22.712934 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-846e8f4d-18dd-42cc-a3b0-0ea8b331c583 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3" status: 404 len: 111 microversion: 2.1 time: 0.033932 May 19 12:26:22.712934 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 434/920] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:26:22 2022] GET /compute/v2.1/servers/7da8d619-7d0b-4cfe-bf0b-f42f7d304db3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:26:22.715468 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0e9888fd-ab57-45fe-9377-75d2dd175db7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] Calling method '.version_select at 0x7f3ba2ae2c10>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:22.798623 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0e9888fd-ab57-45fe-9377-75d2dd175db7 tempest-TestMinimumBasicScenario-279966415 tempest-TestMinimumBasicScenario-279966415-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-696951433" status: 202 len: 0 microversion: 2.1 time: 0.086899 May 19 12:26:22.799209 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 487/921] 10.222.0.23 () {58 vars in 1268 bytes} [Thu May 19 12:26:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-696951433 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:26:50.661860 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:50.662593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:50.864135 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-84fd4ded-fdf3-44a5-92f5-f92bd2346e06 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Action: 'create', calling method: .version_select at 0x7f3b9da2df70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1269836910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjDMewvm9njxHllIGWKJgktkdXRuZGDgjueEuPdM/6mE4e5gxh04bXmesuLUoF30Oq45NRX9mKScyngFh1j3FAJxNIFYHA6A6QidPeUQMjoasVPcPN1YmezUVfnyuh2XA=="}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:26:50.879988 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-84fd4ded-fdf3-44a5-92f5-f92bd2346e06 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Getting quotas for project 4b46044a7f1d471582800c9d8a79e5c5. Resources: {'key_pairs'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:26:50.884082 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-84fd4ded-fdf3-44a5-92f5-f92bd2346e06 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Getting quotas for user 2d158b01a0a74de4bc0131b5c625efdf and project 4b46044a7f1d471582800c9d8a79e5c5. Resources: {'key_pairs'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:26:50.986913 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-84fd4ded-fdf3-44a5-92f5-f92bd2346e06 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.329921 May 19 12:26:50.987676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 435/922] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 19 12:26:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:06.000372 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:06.003323 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:06.005754 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-652d7615-1bca-405b-bd0d-1018810ebdc3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:06.006250 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-652d7615-1bca-405b-bd0d-1018810ebdc3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:06.012214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-652d7615-1bca-405b-bd0d-1018810ebdc3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:06.012675 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-652d7615-1bca-405b-bd0d-1018810ebdc3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:06.013441 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-652d7615-1bca-405b-bd0d-1018810ebdc3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:06.013883 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-652d7615-1bca-405b-bd0d-1018810ebdc3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:06.042075 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-652d7615-1bca-405b-bd0d-1018810ebdc3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/ips" status: 200 len: 149 microversion: 2.1 time: 0.043356 May 19 12:27:06.042663 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 488/923] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 19 12:27:05 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:11.238659 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=4 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:11.239492 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:11.243871 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-1e70c1f9-9f4a-4ace-9e3a-727d8022b1fb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d9d90ce-d546-4184-9a16-77682fecedc5"}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:11.244924 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-1e70c1f9-9f4a-4ace-9e3a-727d8022b1fb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:11.251041 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1e70c1f9-9f4a-4ace-9e3a-727d8022b1fb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:11.251492 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1e70c1f9-9f4a-4ace-9e3a-727d8022b1fb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:11.252293 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1e70c1f9-9f4a-4ace-9e3a-727d8022b1fb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:11.252733 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1e70c1f9-9f4a-4ace-9e3a-727d8022b1fb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:12.943935 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-1e70c1f9-9f4a-4ace-9e3a-727d8022b1fb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "POST /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.706723 May 19 12:27:12.944729 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 436/924] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 19 12:27:11 2022] POST /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/os-volume_attachments => generated 194 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:26.818641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c10a5cc0-e2cc-4e4a-8800-c28c99bb1ee8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d9d90ce-d546-4184-9a16-77682fecedc5"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:26.819715 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c10a5cc0-e2cc-4e4a-8800-c28c99bb1ee8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:26.827962 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c10a5cc0-e2cc-4e4a-8800-c28c99bb1ee8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:26.828414 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c10a5cc0-e2cc-4e4a-8800-c28c99bb1ee8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:26.829190 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c10a5cc0-e2cc-4e4a-8800-c28c99bb1ee8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:26.829626 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c10a5cc0-e2cc-4e4a-8800-c28c99bb1ee8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:26.910343 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-c10a5cc0-e2cc-4e4a-8800-c28c99bb1ee8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] HTTP exception thrown: Invalid volume: volume 5d9d90ce-d546-4184-9a16-77682fecedc5 is already attached to instances: ff26d40f-6c63-40a5-af44-a128df79f323 May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c10a5cc0-e2cc-4e4a-8800-c28c99bb1ee8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Request method failure captured: May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: POST /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/os-volume_attachments HTTP/1.1 May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 74 May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjWEBNF2DeurAd4vIS9t5sXixknAa9oMvXKGIT7BVlMgRbph3mSe132nYVois5KyltYyb0JHe3nInO6bVt7M3Z2oZ1xRzJyjOamBOcNMxIEvcJ1cyR56gBj_EXYQnPZDcjZT6Ja0FtOHx4Rd4HuWodV9rlQ_CBw1MTfirEySyppbNDw May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:27:26.912035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:27:26.915202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2de86d602945238f5df0e2c388004f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:27:26.915202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeNegativeTest-50904330 May 19 12:27:26.915202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:27:26.915202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:27:26.915202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:27:26.915202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:27:26.915202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:27:26.915202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: dd39ddcf4ab045b98a737ee529a2dcce May 19 12:27:26.915202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:27:26.915202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: May 19 12:27:26.915202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {"volumeAttachment": {"volumeId": "5d9d90ce-d546-4184-9a16-77682fecedc5"}} May 19 12:27:26.915202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:27:26.916998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Invalid volume: volume 5d9d90ce-d546-4184-9a16-77682fecedc5 is already attached to instances: ff26d40f-6c63-40a5-af44-a128df79f323 May 19 12:27:26.916998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'server_id': 'ff26d40f-6c63-40a5-af44-a128df79f323', 'body': {'volumeAttachment': {'volumeId': '5d9d90ce-d546-4184-9a16-77682fecedc5'}}} May 19 12:27:26.916998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:27:26.916998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:27:26.916998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 12:27:26.916998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 12:27:26.916998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 12:27:26.916998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 12:27:26.916998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 12:27:26.916998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 12:27:26.916998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 12:27:26.916998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 12:27:26.916998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 12:27:26.916998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 12:27:26.916998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5d9d90ce-d546-4184-9a16-77682fecedc5 is already attached to instances: ff26d40f-6c63-40a5-af44-a128df79f323 May 19 12:27:26.916998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:27:26.916998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:27:26.916998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:27:26.916998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5d9d90ce-d546-4184-9a16-77682fecedc5 is already attached to instances: ff26d40f-6c63-40a5-af44-a128df79f323 May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:27:26.918429 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:27:26.920146 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:27:26.920146 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:27:26.920146 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:27:26.920146 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5d9d90ce-d546-4184-9a16-77682fecedc5 is already attached to instances: ff26d40f-6c63-40a5-af44-a128df79f323 May 19 12:27:26.920146 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:27:26.920146 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c10a5cc0-e2cc-4e4a-8800-c28c99bb1ee8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Returning 400 to user: Invalid volume: volume 5d9d90ce-d546-4184-9a16-77682fecedc5 is already attached to instances: ff26d40f-6c63-40a5-af44-a128df79f323 {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:27:26.920146 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c10a5cc0-e2cc-4e4a-8800-c28c99bb1ee8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "POST /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099583 May 19 12:27:26.920146 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 489/925] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 19 12:27:26 2022] POST /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 12:27:26.984063 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a1d85893-6f8d-48ab-a7f8-e1acda7813b0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:26.984063 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a1d85893-6f8d-48ab-a7f8-e1acda7813b0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:26.984063 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=2 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:26.984063 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:26.988181 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a1d85893-6f8d-48ab-a7f8-e1acda7813b0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:26.988630 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a1d85893-6f8d-48ab-a7f8-e1acda7813b0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:26.989397 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a1d85893-6f8d-48ab-a7f8-e1acda7813b0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:26.989834 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a1d85893-6f8d-48ab-a7f8-e1acda7813b0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:27.072831 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.objects.instance [None req-a1d85893-6f8d-48ab-a7f8-e1acda7813b0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lazy-loading 'services' on Instance uuid ff26d40f-6c63-40a5-af44-a128df79f323 {{(pid=117964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:27:27.572906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a1d85893-6f8d-48ab-a7f8-e1acda7813b0 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/os-volume_attachments/5d9d90ce-d546-4184-9a16-77682fecedc5" status: 202 len: 0 microversion: 2.1 time: 0.598416 May 19 12:27:27.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 437/926] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 19 12:27:26 2022] DELETE /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/os-volume_attachments/5d9d90ce-d546-4184-9a16-77682fecedc5 => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:27:27.588613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-46e6f0e0-7555-4f3d-8a9b-92ec7f259f49 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:27.588613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-46e6f0e0-7555-4f3d-8a9b-92ec7f259f49 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:27.593250 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-46e6f0e0-7555-4f3d-8a9b-92ec7f259f49 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:27.593424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-46e6f0e0-7555-4f3d-8a9b-92ec7f259f49 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:27.594293 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-46e6f0e0-7555-4f3d-8a9b-92ec7f259f49 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:27.594733 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-46e6f0e0-7555-4f3d-8a9b-92ec7f259f49 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:27.666543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-46e6f0e0-7555-4f3d-8a9b-92ec7f259f49 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047372 May 19 12:27:27.666543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 490/927] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:27:27 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:28.677436 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-afe1f939-97df-4e91-ac15-7b2ab73a2541 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:28.678441 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-afe1f939-97df-4e91-ac15-7b2ab73a2541 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:28.685689 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-afe1f939-97df-4e91-ac15-7b2ab73a2541 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:28.686183 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-afe1f939-97df-4e91-ac15-7b2ab73a2541 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:28.686903 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-afe1f939-97df-4e91-ac15-7b2ab73a2541 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:28.687335 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-afe1f939-97df-4e91-ac15-7b2ab73a2541 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:28.717095 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-afe1f939-97df-4e91-ac15-7b2ab73a2541 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044358 May 19 12:27:28.721607 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 438/928] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:27:28 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:29.729634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e98f0422-f644-48bf-97ec-eac9ec7a5995 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:29.730588 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e98f0422-f644-48bf-97ec-eac9ec7a5995 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:29.737393 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e98f0422-f644-48bf-97ec-eac9ec7a5995 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:29.737841 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e98f0422-f644-48bf-97ec-eac9ec7a5995 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:29.738604 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e98f0422-f644-48bf-97ec-eac9ec7a5995 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:29.739041 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e98f0422-f644-48bf-97ec-eac9ec7a5995 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:29.770014 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e98f0422-f644-48bf-97ec-eac9ec7a5995 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045373 May 19 12:27:29.770569 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 491/929] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:27:29 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:27:30.782991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-bae9788e-179f-4aeb-b8aa-f0f9c2d3553a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:30.784029 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-bae9788e-179f-4aeb-b8aa-f0f9c2d3553a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:30.792386 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bae9788e-179f-4aeb-b8aa-f0f9c2d3553a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:30.792935 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bae9788e-179f-4aeb-b8aa-f0f9c2d3553a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:30.793851 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bae9788e-179f-4aeb-b8aa-f0f9c2d3553a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:30.794227 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bae9788e-179f-4aeb-b8aa-f0f9c2d3553a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:30.825564 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-bae9788e-179f-4aeb-b8aa-f0f9c2d3553a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047431 May 19 12:27:30.826123 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 439/930] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:27:30 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:31.837041 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-93e0980b-2d61-42f9-b6a9-85194d1e6cc8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:31.837989 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-93e0980b-2d61-42f9-b6a9-85194d1e6cc8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:31.845797 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-93e0980b-2d61-42f9-b6a9-85194d1e6cc8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:31.850794 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-93e0980b-2d61-42f9-b6a9-85194d1e6cc8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:31.850794 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-93e0980b-2d61-42f9-b6a9-85194d1e6cc8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:31.850794 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-93e0980b-2d61-42f9-b6a9-85194d1e6cc8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:31.881494 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-93e0980b-2d61-42f9-b6a9-85194d1e6cc8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048595 May 19 12:27:31.882094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 492/931] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:27:31 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 12:27:31.947807 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-4d6e8c27-7ba8-4521-b576-3520547ad554 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:31.949110 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-4d6e8c27-7ba8-4521-b576-3520547ad554 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:31.957320 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4d6e8c27-7ba8-4521-b576-3520547ad554 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:31.957860 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4d6e8c27-7ba8-4521-b576-3520547ad554 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:31.958728 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4d6e8c27-7ba8-4521-b576-3520547ad554 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:31.959178 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4d6e8c27-7ba8-4521-b576-3520547ad554 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:31.970294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6dc13e0c-235a-4a75-9398-8232b0f9cd3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1991315436", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1269836910", "security_groups": [{"name": "tempest-secgroup-smoke-422211665"}], "block_device_mapping_v2": [{"uuid": "c49e05f7-2463-4c19-81d9-912aa05f0c5c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8cb239d8-0b94-495c-8855-e9aad30a1cb5"}]}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:31.989217 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-4d6e8c27-7ba8-4521-b576-3520547ad554 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Going to try to terminate instance {{(pid=117964) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:27:32.108884 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-6dc13e0c-235a-4a75-9398-8232b0f9cd3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] validate_networks() for [('8cb239d8-0b94-495c-8855-e9aad30a1cb5', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:27:32.333136 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-4d6e8c27-7ba8-4521-b576-3520547ad554 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 204 len: 0 microversion: 2.1 time: 0.389451 May 19 12:27:32.333731 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 440/932] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:27:31 2022] DELETE /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:27:32.342999 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-1bb4b31e-aa25-4bea-a6c5-ba26f5fe7f09 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:32.343711 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-1bb4b31e-aa25-4bea-a6c5-ba26f5fe7f09 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:32.350178 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1bb4b31e-aa25-4bea-a6c5-ba26f5fe7f09 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:32.350640 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1bb4b31e-aa25-4bea-a6c5-ba26f5fe7f09 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:32.351415 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1bb4b31e-aa25-4bea-a6c5-ba26f5fe7f09 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:32.351876 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1bb4b31e-aa25-4bea-a6c5-ba26f5fe7f09 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:32.567394 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-1bb4b31e-aa25-4bea-a6c5-ba26f5fe7f09 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:32.575249 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-1bb4b31e-aa25-4bea-a6c5-ba26f5fe7f09 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 200 len: 1681 microversion: 2.1 time: 0.237119 May 19 12:27:32.575848 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 441/933] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:32 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 1681 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:27:32.582832 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-6dc13e0c-235a-4a75-9398-8232b0f9cd3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:27:32.583265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-6dc13e0c-235a-4a75-9398-8232b0f9cd3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:27:32.583745 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-6dc13e0c-235a-4a75-9398-8232b0f9cd3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:27:32.584189 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-6dc13e0c-235a-4a75-9398-8232b0f9cd3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:27:32.584607 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-6dc13e0c-235a-4a75-9398-8232b0f9cd3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:27:32.594821 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6dc13e0c-235a-4a75-9398-8232b0f9cd3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:32.595280 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6dc13e0c-235a-4a75-9398-8232b0f9cd3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:32.596113 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6dc13e0c-235a-4a75-9398-8232b0f9cd3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:32.596558 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6dc13e0c-235a-4a75-9398-8232b0f9cd3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:32.614149 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-6dc13e0c-235a-4a75-9398-8232b0f9cd3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Getting quotas for project 4b46044a7f1d471582800c9d8a79e5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:27:32.618151 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-6dc13e0c-235a-4a75-9398-8232b0f9cd3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Getting quotas for user 2d158b01a0a74de4bc0131b5c625efdf and project 4b46044a7f1d471582800c9d8a79e5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:27:32.676223 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6dc13e0c-235a-4a75-9398-8232b0f9cd3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:27:32.678344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6dc13e0c-235a-4a75-9398-8232b0f9cd3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c49e05f7-2463-4c19-81d9-912aa05f0c5c',volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:27:33.317677 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6dc13e0c-235a-4a75-9398-8232b0f9cd3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.351431 May 19 12:27:33.318400 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 493/934] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:27:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 12:27:33.337458 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-68a9fb1b-53b6-4119-86aa-031193beeb64 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:33.338630 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-68a9fb1b-53b6-4119-86aa-031193beeb64 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:33.396327 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-68a9fb1b-53b6-4119-86aa-031193beeb64 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:33.424153 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-68a9fb1b-53b6-4119-86aa-031193beeb64 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1095 microversion: 2.1 time: 0.072534 May 19 12:27:33.424153 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 442/935] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:33 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:33.592755 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c95f100c-300b-403d-8adc-d3e6979200d1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:33.593382 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c95f100c-300b-403d-8adc-d3e6979200d1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:33.600557 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c95f100c-300b-403d-8adc-d3e6979200d1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:33.601113 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c95f100c-300b-403d-8adc-d3e6979200d1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:33.602094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c95f100c-300b-403d-8adc-d3e6979200d1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:33.602539 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c95f100c-300b-403d-8adc-d3e6979200d1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:33.740959 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c95f100c-300b-403d-8adc-d3e6979200d1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:33.749192 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c95f100c-300b-403d-8adc-d3e6979200d1 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 200 len: 1681 microversion: 2.1 time: 0.160640 May 19 12:27:33.749761 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 494/936] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:33 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:34.421188 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-7257471c-d498-4940-b59d-ad0a7f0096f6 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:34.421769 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-7257471c-d498-4940-b59d-ad0a7f0096f6 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:34.478838 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-7257471c-d498-4940-b59d-ad0a7f0096f6 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:34.486004 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-7257471c-d498-4940-b59d-ad0a7f0096f6 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1095 microversion: 2.1 time: 0.069521 May 19 12:27:34.486575 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 443/937] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:34 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:34.767387 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-38d2c645-01f4-4e68-8895-09cc111234be tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:34.767969 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-38d2c645-01f4-4e68-8895-09cc111234be tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:34.774920 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-38d2c645-01f4-4e68-8895-09cc111234be tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:34.775448 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-38d2c645-01f4-4e68-8895-09cc111234be tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:34.776269 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-38d2c645-01f4-4e68-8895-09cc111234be tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:34.778406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-38d2c645-01f4-4e68-8895-09cc111234be tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:34.920968 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-38d2c645-01f4-4e68-8895-09cc111234be tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:34.929343 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-38d2c645-01f4-4e68-8895-09cc111234be tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 200 len: 1681 microversion: 2.1 time: 0.165878 May 19 12:27:34.929937 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 495/938] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:34 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:35.503586 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f223b9aa-f10c-407f-8d19-61a57259b897 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:35.504230 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f223b9aa-f10c-407f-8d19-61a57259b897 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:35.511999 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f223b9aa-f10c-407f-8d19-61a57259b897 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:35.512368 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f223b9aa-f10c-407f-8d19-61a57259b897 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:35.513154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f223b9aa-f10c-407f-8d19-61a57259b897 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:35.513591 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f223b9aa-f10c-407f-8d19-61a57259b897 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:35.583049 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f223b9aa-f10c-407f-8d19-61a57259b897 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:35.592193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f223b9aa-f10c-407f-8d19-61a57259b897 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1193 microversion: 2.1 time: 0.092475 May 19 12:27:35.592789 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 444/939] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:35 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1193 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:27:35.861699 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-269a3e70-6f28-4ca1-bb3e-451aa742ced0 req-b68f112f-458e-4604-9762-7d9734f7204d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff26d40f-6c63-40a5-af44-a128df79f323", "name": "network-vif-deleted", "tag": "d05810c6-219e-400a-88f4-a1ee78e52890"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:35.872338 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-269a3e70-6f28-4ca1-bb3e-451aa742ced0 req-b68f112f-458e-4604-9762-7d9734f7204d service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:35.873033 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-269a3e70-6f28-4ca1-bb3e-451aa742ced0 req-b68f112f-458e-4604-9762-7d9734f7204d service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:35.886291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-269a3e70-6f28-4ca1-bb3e-451aa742ced0 req-b68f112f-458e-4604-9762-7d9734f7204d service nova] Creating event network-vif-deleted:d05810c6-219e-400a-88f4-a1ee78e52890 for instance ff26d40f-6c63-40a5-af44-a128df79f323 on hv-cinder-80475 May 19 12:27:35.893243 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-269a3e70-6f28-4ca1-bb3e-451aa742ced0 req-b68f112f-458e-4604-9762-7d9734f7204d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036547 May 19 12:27:35.894227 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 496/940] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:35.949418 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9c063872-a940-4290-a449-71947dad2511 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:35.951049 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9c063872-a940-4290-a449-71947dad2511 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:35.962150 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9c063872-a940-4290-a449-71947dad2511 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:35.962952 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9c063872-a940-4290-a449-71947dad2511 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:35.964089 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9c063872-a940-4290-a449-71947dad2511 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:35.975677 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9c063872-a940-4290-a449-71947dad2511 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:36.079304 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9c063872-a940-4290-a449-71947dad2511 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:36.082527 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9c063872-a940-4290-a449-71947dad2511 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 200 len: 1614 microversion: 2.1 time: 0.138330 May 19 12:27:36.083123 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 445/941] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:35 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 1614 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:27:36.617815 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ff30020d-cb36-475c-8f39-e8eb9f60e685 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:36.617815 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ff30020d-cb36-475c-8f39-e8eb9f60e685 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:36.623193 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ff30020d-cb36-475c-8f39-e8eb9f60e685 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:36.623648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ff30020d-cb36-475c-8f39-e8eb9f60e685 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:36.624587 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ff30020d-cb36-475c-8f39-e8eb9f60e685 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:36.625212 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ff30020d-cb36-475c-8f39-e8eb9f60e685 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:36.695224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ff30020d-cb36-475c-8f39-e8eb9f60e685 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:36.705509 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ff30020d-cb36-475c-8f39-e8eb9f60e685 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1211 microversion: 2.1 time: 0.095975 May 19 12:27:36.706365 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 497/942] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:36 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:37.101443 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-8223ec29-20b6-45a9-8f90-b94857e678ff tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:37.102105 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-8223ec29-20b6-45a9-8f90-b94857e678ff tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:37.110049 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8223ec29-20b6-45a9-8f90-b94857e678ff tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:37.110509 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8223ec29-20b6-45a9-8f90-b94857e678ff tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:37.111335 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8223ec29-20b6-45a9-8f90-b94857e678ff tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:37.111904 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8223ec29-20b6-45a9-8f90-b94857e678ff tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:37.126922 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-8223ec29-20b6-45a9-8f90-b94857e678ff tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] HTTP exception thrown: Instance ff26d40f-6c63-40a5-af44-a128df79f323 could not be found. May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-8223ec29-20b6-45a9-8f90-b94857e678ff tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Request method failure captured: May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 HTTP/1.1 May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjWEBNF2DeurAd4vIS9t5sXixknAa9oMvXKGIT7BVlMgRbph3mSe132nYVois5KyltYyb0JHe3nInO6bVt7M3Z2oZ1xRzJyjOamBOcNMxIEvcJ1cyR56gBj_EXYQnPZDcjZT6Ja0FtOHx4Rd4HuWodV9rlQ_CBw1MTfirEySyppbNDw May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:27:37.128773 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:27:37.130628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2de86d602945238f5df0e2c388004f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:27:37.130628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-AttachVolumeNegativeTest-50904330 May 19 12:27:37.130628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:27:37.130628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:27:37.130628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:27:37.130628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:27:37.130628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:27:37.130628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: dd39ddcf4ab045b98a737ee529a2dcce May 19 12:27:37.130628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:27:37.130628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:27:37.130628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance ff26d40f-6c63-40a5-af44-a128df79f323 could not be found. May 19 12:27:37.130628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': 'ff26d40f-6c63-40a5-af44-a128df79f323'} May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff26d40f-6c63-40a5-af44-a128df79f323 could not be found. May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:27:37.131514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:27:37.133121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:27:37.133121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:27:37.133121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:27:37.133121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:27:37.133121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:27:37.133121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:27:37.133121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:27:37.133121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff26d40f-6c63-40a5-af44-a128df79f323 could not be found. May 19 12:27:37.133121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:27:37.133121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:27:37.133121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:27:37.133121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:27:37.133121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:27:37.133121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:27:37.133121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:27:37.133121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:27:37.133121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff26d40f-6c63-40a5-af44-a128df79f323 could not be found. May 19 12:27:37.133121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:27:37.134366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-8223ec29-20b6-45a9-8f90-b94857e678ff tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Returning 404 to user: Instance ff26d40f-6c63-40a5-af44-a128df79f323 could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:27:37.134366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-8223ec29-20b6-45a9-8f90-b94857e678ff tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 404 len: 111 microversion: 2.1 time: 0.032792 May 19 12:27:37.134366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 446/943] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:37 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:27:37.140513 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a140efc2-dbfa-4b30-b50f-9d5426cf1305 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '.version_select at 0x7f3ba2991d30>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:37.241452 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a140efc2-dbfa-4b30-b50f-9d5426cf1305 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1952522990" status: 202 len: 0 microversion: 2.1 time: 0.105621 May 19 12:27:37.242287 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 498/944] 10.222.0.23 () {58 vars in 1220 bytes} [Thu May 19 12:27:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1952522990 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:27:37.724623 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-10b769bc-c4ec-44c3-ad39-69ccd4c2df42 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:37.725159 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-10b769bc-c4ec-44c3-ad39-69ccd4c2df42 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:37.744820 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-10b769bc-c4ec-44c3-ad39-69ccd4c2df42 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:37.747664 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-10b769bc-c4ec-44c3-ad39-69ccd4c2df42 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:37.747664 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-10b769bc-c4ec-44c3-ad39-69ccd4c2df42 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:37.747664 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-10b769bc-c4ec-44c3-ad39-69ccd4c2df42 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:37.972703 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-10b769bc-c4ec-44c3-ad39-69ccd4c2df42 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:37.981958 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-10b769bc-c4ec-44c3-ad39-69ccd4c2df42 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1278 microversion: 2.1 time: 0.261260 May 19 12:27:37.982554 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 447/945] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:37 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1278 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:38.108310 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-2d8f9255-4266-4fdc-975e-7068eaa5e238 req-78bea8db-85de-47f6-b9aa-e8a113d88b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5e1226-df90-46cb-b63b-38a15848fa99", "tag": "8f049042-efb1-4f34-b024-4e6aa097edab"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:38.129248 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-2d8f9255-4266-4fdc-975e-7068eaa5e238 req-78bea8db-85de-47f6-b9aa-e8a113d88b4d service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:38.129248 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-2d8f9255-4266-4fdc-975e-7068eaa5e238 req-78bea8db-85de-47f6-b9aa-e8a113d88b4d service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:38.141665 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-2d8f9255-4266-4fdc-975e-7068eaa5e238 req-78bea8db-85de-47f6-b9aa-e8a113d88b4d service nova] Creating event network-changed:8f049042-efb1-4f34-b024-4e6aa097edab for instance fd5e1226-df90-46cb-b63b-38a15848fa99 on hv-cinder-80475 May 19 12:27:38.147057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-2d8f9255-4266-4fdc-975e-7068eaa5e238 req-78bea8db-85de-47f6-b9aa-e8a113d88b4d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043486 May 19 12:27:38.152117 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 499/946] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:38.430776 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-afea2070-307b-4ab0-ad8c-883c3b138e56 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Action: 'create', calling method: .version_select at 0x7f3b9da2d280>, body: {"keypair": {"name": "tempest-keypair-1109007285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmxzeGBDYlWB/aJ0/TSf289wiHeUU5giRUPtv/dybLvxMSKXINFpM98ArEWB+9LRFinZfqcAXUzkg+J5ANgFeFTKzbvujidFTZF7Eg0bDK5XsDZ8AskxggvfGXvilTGfg=="}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:38.446287 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-afea2070-307b-4ab0-ad8c-883c3b138e56 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Getting quotas for project 1d2de86d602945238f5df0e2c388004f. Resources: {'key_pairs'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:27:38.451260 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-afea2070-307b-4ab0-ad8c-883c3b138e56 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Getting quotas for user dd39ddcf4ab045b98a737ee529a2dcce and project 1d2de86d602945238f5df0e2c388004f. Resources: {'key_pairs'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:27:38.562790 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-afea2070-307b-4ab0-ad8c-883c3b138e56 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.135843 May 19 12:27:38.563390 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 448/947] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 19 12:27:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:39.001675 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0e76fc9d-b2f6-4cb3-89ee-9c75bbdc4310 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:39.002384 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0e76fc9d-b2f6-4cb3-89ee-9c75bbdc4310 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:39.008953 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e76fc9d-b2f6-4cb3-89ee-9c75bbdc4310 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:39.009367 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e76fc9d-b2f6-4cb3-89ee-9c75bbdc4310 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:39.010145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e76fc9d-b2f6-4cb3-89ee-9c75bbdc4310 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:39.010598 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e76fc9d-b2f6-4cb3-89ee-9c75bbdc4310 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:39.197438 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0e76fc9d-b2f6-4cb3-89ee-9c75bbdc4310 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:39.207325 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0e76fc9d-b2f6-4cb3-89ee-9c75bbdc4310 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1266 microversion: 2.1 time: 0.210726 May 19 12:27:39.207916 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 500/948] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:38 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:40.224994 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5968f735-7065-40f4-b6b1-10f022cdf4da tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:40.225614 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5968f735-7065-40f4-b6b1-10f022cdf4da tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:40.233835 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5968f735-7065-40f4-b6b1-10f022cdf4da tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:40.234275 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5968f735-7065-40f4-b6b1-10f022cdf4da tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:40.235304 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5968f735-7065-40f4-b6b1-10f022cdf4da tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:40.235744 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5968f735-7065-40f4-b6b1-10f022cdf4da tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:40.485220 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5968f735-7065-40f4-b6b1-10f022cdf4da tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:40.493117 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5968f735-7065-40f4-b6b1-10f022cdf4da tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1266 microversion: 2.1 time: 0.272202 May 19 12:27:40.493696 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 449/949] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:40 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1266 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:41.244357 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a51f5f24-4acd-4d77-bb94-fe225099e1c7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-124822700", "imageRef": "962252c6-9c2c-4b81-bdb7-f6d317bada3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "744c5d15-060b-4067-aa62-eecc19d1b85e"}], "security_groups": [{"name": "tempest-securitygroup--1985542961"}], "key_name": "tempest-keypair-1109007285", "user_data": "}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:41.348630 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-a51f5f24-4acd-4d77-bb94-fe225099e1c7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] validate_networks() for [('744c5d15-060b-4067-aa62-eecc19d1b85e', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:27:41.510596 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-17efb71a-389e-4794-927e-a5d7982a4771 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:41.511927 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-17efb71a-389e-4794-927e-a5d7982a4771 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:41.519052 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-17efb71a-389e-4794-927e-a5d7982a4771 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:41.519525 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-17efb71a-389e-4794-927e-a5d7982a4771 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:41.520347 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-17efb71a-389e-4794-927e-a5d7982a4771 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:41.520797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-17efb71a-389e-4794-927e-a5d7982a4771 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:41.806095 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-17efb71a-389e-4794-927e-a5d7982a4771 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:41.815450 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-17efb71a-389e-4794-927e-a5d7982a4771 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1266 microversion: 2.1 time: 0.308714 May 19 12:27:41.816155 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 450/950] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:41 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1266 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:27:41.841890 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-a51f5f24-4acd-4d77-bb94-fe225099e1c7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:27:41.842328 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-a51f5f24-4acd-4d77-bb94-fe225099e1c7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:27:41.842871 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-a51f5f24-4acd-4d77-bb94-fe225099e1c7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:27:41.843365 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-a51f5f24-4acd-4d77-bb94-fe225099e1c7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:27:41.843830 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-a51f5f24-4acd-4d77-bb94-fe225099e1c7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:27:41.853405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a51f5f24-4acd-4d77-bb94-fe225099e1c7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:41.853864 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a51f5f24-4acd-4d77-bb94-fe225099e1c7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:41.854910 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a51f5f24-4acd-4d77-bb94-fe225099e1c7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:41.855351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a51f5f24-4acd-4d77-bb94-fe225099e1c7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:41.875021 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-a51f5f24-4acd-4d77-bb94-fe225099e1c7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Getting quotas for project 1d2de86d602945238f5df0e2c388004f. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:27:41.879428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-a51f5f24-4acd-4d77-bb94-fe225099e1c7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Getting quotas for user dd39ddcf4ab045b98a737ee529a2dcce and project 1d2de86d602945238f5df0e2c388004f. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:27:41.892385 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a51f5f24-4acd-4d77-bb94-fe225099e1c7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:27:41.894815 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a51f5f24-4acd-4d77-bb94-fe225099e1c7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962252c6-9c2c-4b81-bdb7-f6d317bada3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:27:42.025197 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a51f5f24-4acd-4d77-bb94-fe225099e1c7 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.785025 May 19 12:27:42.026148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 501/951] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:27:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:27:42.035973 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f9d9dbf6-efa6-4e06-b70f-666374d4aa5f tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:42.036590 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f9d9dbf6-efa6-4e06-b70f-666374d4aa5f tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:42.097751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f9d9dbf6-efa6-4e06-b70f-666374d4aa5f tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:42.105467 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f9d9dbf6-efa6-4e06-b70f-666374d4aa5f tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1241 microversion: 2.1 time: 0.072823 May 19 12:27:42.106117 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 451/952] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:42 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:42.837913 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9eb35c29-2420-4d9d-a679-e76a41a42ec3 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:42.839358 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9eb35c29-2420-4d9d-a679-e76a41a42ec3 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:42.848796 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9eb35c29-2420-4d9d-a679-e76a41a42ec3 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:42.849366 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9eb35c29-2420-4d9d-a679-e76a41a42ec3 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:42.850422 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9eb35c29-2420-4d9d-a679-e76a41a42ec3 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:42.851013 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9eb35c29-2420-4d9d-a679-e76a41a42ec3 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:43.002303 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9eb35c29-2420-4d9d-a679-e76a41a42ec3 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:43.010352 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9eb35c29-2420-4d9d-a679-e76a41a42ec3 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1266 microversion: 2.1 time: 0.177187 May 19 12:27:43.011009 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 502/953] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:42 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:43.123242 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a8ac8122-9ce8-4658-8fcc-4f448c885c51 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:43.124000 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a8ac8122-9ce8-4658-8fcc-4f448c885c51 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:43.130895 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a8ac8122-9ce8-4658-8fcc-4f448c885c51 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:43.131372 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a8ac8122-9ce8-4658-8fcc-4f448c885c51 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:43.132173 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a8ac8122-9ce8-4658-8fcc-4f448c885c51 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:43.132614 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a8ac8122-9ce8-4658-8fcc-4f448c885c51 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:43.208414 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a8ac8122-9ce8-4658-8fcc-4f448c885c51 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:43.218153 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a8ac8122-9ce8-4658-8fcc-4f448c885c51 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1245 microversion: 2.1 time: 0.098846 May 19 12:27:43.218824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 452/954] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:43 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1245 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:44.027108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f6ad204e-ea64-44df-9965-2e4b78091ed4 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:44.027730 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f6ad204e-ea64-44df-9965-2e4b78091ed4 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:44.035724 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f6ad204e-ea64-44df-9965-2e4b78091ed4 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:44.036234 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f6ad204e-ea64-44df-9965-2e4b78091ed4 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:44.037022 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f6ad204e-ea64-44df-9965-2e4b78091ed4 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:44.037460 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f6ad204e-ea64-44df-9965-2e4b78091ed4 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:44.186778 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f6ad204e-ea64-44df-9965-2e4b78091ed4 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:44.195235 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f6ad204e-ea64-44df-9965-2e4b78091ed4 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1266 microversion: 2.1 time: 0.172072 May 19 12:27:44.196118 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 503/955] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:44 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:44.238627 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-cca8ee75-9e05-4cea-8504-f03edf454363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:44.239750 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-cca8ee75-9e05-4cea-8504-f03edf454363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:44.250098 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-cca8ee75-9e05-4cea-8504-f03edf454363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:44.257855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-cca8ee75-9e05-4cea-8504-f03edf454363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:44.257855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-cca8ee75-9e05-4cea-8504-f03edf454363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:44.257855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-cca8ee75-9e05-4cea-8504-f03edf454363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:44.363803 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-cca8ee75-9e05-4cea-8504-f03edf454363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:44.379635 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-cca8ee75-9e05-4cea-8504-f03edf454363 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1293 microversion: 2.1 time: 0.147692 May 19 12:27:44.383998 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 453/956] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:44 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1293 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:45.214693 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b8f98c45-3043-4c3a-ab51-4c46d75b6a55 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:45.215381 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b8f98c45-3043-4c3a-ab51-4c46d75b6a55 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:45.222207 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b8f98c45-3043-4c3a-ab51-4c46d75b6a55 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:45.222655 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b8f98c45-3043-4c3a-ab51-4c46d75b6a55 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:45.223470 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b8f98c45-3043-4c3a-ab51-4c46d75b6a55 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:45.224305 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b8f98c45-3043-4c3a-ab51-4c46d75b6a55 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:45.395678 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b8f98c45-3043-4c3a-ab51-4c46d75b6a55 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:45.398899 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d17b63a4-6140-4f2a-a647-2947a1e6d069 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:45.399668 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d17b63a4-6140-4f2a-a647-2947a1e6d069 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:45.408043 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b8f98c45-3043-4c3a-ab51-4c46d75b6a55 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1266 microversion: 2.1 time: 0.197875 May 19 12:27:45.408977 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 504/957] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:45 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:27:45.410439 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d17b63a4-6140-4f2a-a647-2947a1e6d069 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:45.411920 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d17b63a4-6140-4f2a-a647-2947a1e6d069 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:45.412977 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d17b63a4-6140-4f2a-a647-2947a1e6d069 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:45.413907 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d17b63a4-6140-4f2a-a647-2947a1e6d069 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:45.500211 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d17b63a4-6140-4f2a-a647-2947a1e6d069 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:45.509351 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d17b63a4-6140-4f2a-a647-2947a1e6d069 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1299 microversion: 2.1 time: 0.115261 May 19 12:27:45.510112 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 454/958] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:45 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:27:45.999339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-94be759d-ef3c-4684-8148-081fc4d24e93 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:46.000653 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-94be759d-ef3c-4684-8148-081fc4d24e93 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:46.014962 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-5355f8e5-cfe7-49de-b3ce-5f125545b248 req-6cafc301-4b9f-4768-ae99-267f9fc30c44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9431305d-b1c8-46c1-9625-0d2e0643174e", "tag": "d1aaf37f-d3ed-4dc1-91e2-f291ae051dbf"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:46.054435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-94be759d-ef3c-4684-8148-081fc4d24e93 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:46.064164 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-94be759d-ef3c-4684-8148-081fc4d24e93 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:46.064164 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-94be759d-ef3c-4684-8148-081fc4d24e93 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:46.064164 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-94be759d-ef3c-4684-8148-081fc4d24e93 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:46.064880 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-5355f8e5-cfe7-49de-b3ce-5f125545b248 req-6cafc301-4b9f-4768-ae99-267f9fc30c44 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:46.064880 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-5355f8e5-cfe7-49de-b3ce-5f125545b248 req-6cafc301-4b9f-4768-ae99-267f9fc30c44 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:46.087597 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-5355f8e5-cfe7-49de-b3ce-5f125545b248 req-6cafc301-4b9f-4768-ae99-267f9fc30c44 service nova] Creating event network-changed:d1aaf37f-d3ed-4dc1-91e2-f291ae051dbf for instance 9431305d-b1c8-46c1-9625-0d2e0643174e on hv-cinder-80475 May 19 12:27:46.102478 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-5355f8e5-cfe7-49de-b3ce-5f125545b248 req-6cafc301-4b9f-4768-ae99-267f9fc30c44 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095938 May 19 12:27:46.103881 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 455/959] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:46.168316 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-94be759d-ef3c-4684-8148-081fc4d24e93 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:27:46.434889 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-4328bd09-4b61-4545-91ad-ac2111e89e47 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:46.436493 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-4328bd09-4b61-4545-91ad-ac2111e89e47 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:46.445480 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4328bd09-4b61-4545-91ad-ac2111e89e47 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:46.446288 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4328bd09-4b61-4545-91ad-ac2111e89e47 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:46.447306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4328bd09-4b61-4545-91ad-ac2111e89e47 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:46.447979 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4328bd09-4b61-4545-91ad-ac2111e89e47 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:46.473032 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:46.620627 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-4328bd09-4b61-4545-91ad-ac2111e89e47 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:46.637432 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-4328bd09-4b61-4545-91ad-ac2111e89e47 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1266 microversion: 2.1 time: 0.207698 May 19 12:27:46.654423 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 456/960] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:46 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:27:46.658400 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6a9ee684-c8a1-40b6-a834-798a57e9a57e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:46.659131 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6a9ee684-c8a1-40b6-a834-798a57e9a57e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:46.672721 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-94be759d-ef3c-4684-8148-081fc4d24e93 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 204 len: 0 microversion: 2.1 time: 0.681013 May 19 12:27:46.677494 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 505/961] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:27:45 2022] DELETE /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 0 bytes in 683 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:27:46.687578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6a9ee684-c8a1-40b6-a834-798a57e9a57e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:46.689112 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b6a6383d-3dc7-4fb0-bc64-5dc2892665d9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:46.690026 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b6a6383d-3dc7-4fb0-bc64-5dc2892665d9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:46.691007 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6a9ee684-c8a1-40b6-a834-798a57e9a57e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:46.693235 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6a9ee684-c8a1-40b6-a834-798a57e9a57e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:46.694579 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6a9ee684-c8a1-40b6-a834-798a57e9a57e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:46.703143 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b6a6383d-3dc7-4fb0-bc64-5dc2892665d9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:46.703826 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b6a6383d-3dc7-4fb0-bc64-5dc2892665d9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:46.705109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b6a6383d-3dc7-4fb0-bc64-5dc2892665d9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:46.705792 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b6a6383d-3dc7-4fb0-bc64-5dc2892665d9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:47.022754 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6a9ee684-c8a1-40b6-a834-798a57e9a57e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:47.034379 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b6a6383d-3dc7-4fb0-bc64-5dc2892665d9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:47.034715 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6a9ee684-c8a1-40b6-a834-798a57e9a57e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1367 microversion: 2.1 time: 0.380340 May 19 12:27:47.035946 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 457/962] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:46 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1367 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:47.039416 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:47.047475 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b6a6383d-3dc7-4fb0-bc64-5dc2892665d9 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1569 microversion: 2.1 time: 0.368524 May 19 12:27:47.048775 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 506/963] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:46 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1569 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:27:47.662862 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0273344f-fb15-4cf4-a3a6-d561556d21d8 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:47.663515 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0273344f-fb15-4cf4-a3a6-d561556d21d8 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:47.678812 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0273344f-fb15-4cf4-a3a6-d561556d21d8 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:47.679681 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0273344f-fb15-4cf4-a3a6-d561556d21d8 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:47.681031 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0273344f-fb15-4cf4-a3a6-d561556d21d8 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:47.681724 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0273344f-fb15-4cf4-a3a6-d561556d21d8 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:47.843383 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-0273344f-fb15-4cf4-a3a6-d561556d21d8 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:47.852877 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0273344f-fb15-4cf4-a3a6-d561556d21d8 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1266 microversion: 2.1 time: 0.194699 May 19 12:27:47.863523 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 458/964] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:47 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:48.060741 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8a7d09cf-1098-4f41-8c02-36be87a86a59 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:48.061523 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8a7d09cf-1098-4f41-8c02-36be87a86a59 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:48.073999 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8a7d09cf-1098-4f41-8c02-36be87a86a59 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:48.074197 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8a7d09cf-1098-4f41-8c02-36be87a86a59 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:48.075455 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8a7d09cf-1098-4f41-8c02-36be87a86a59 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:48.076062 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8a7d09cf-1098-4f41-8c02-36be87a86a59 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:48.112517 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6f772928-e362-4c9b-ad3d-1fa1ba7b0281 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:48.113060 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6f772928-e362-4c9b-ad3d-1fa1ba7b0281 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:48.120717 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6f772928-e362-4c9b-ad3d-1fa1ba7b0281 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:48.121169 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6f772928-e362-4c9b-ad3d-1fa1ba7b0281 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:48.122204 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6f772928-e362-4c9b-ad3d-1fa1ba7b0281 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:48.122869 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6f772928-e362-4c9b-ad3d-1fa1ba7b0281 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:48.293682 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8a7d09cf-1098-4f41-8c02-36be87a86a59 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:48.304059 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8a7d09cf-1098-4f41-8c02-36be87a86a59 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1367 microversion: 2.1 time: 0.249206 May 19 12:27:48.304655 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 507/965] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:48 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:48.310444 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-36632311-f089-4bec-ac1e-d24d8a850a2d req-6d631ce7-261f-4fc6-8425-f69f14080999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4044bf22-d9bc-4d48-b10d-7ad3da39ebd7", "tag": "20c5c364-3274-4170-8229-3c010171aa57"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:48.319994 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-36632311-f089-4bec-ac1e-d24d8a850a2d req-6d631ce7-261f-4fc6-8425-f69f14080999 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:48.320913 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-36632311-f089-4bec-ac1e-d24d8a850a2d req-6d631ce7-261f-4fc6-8425-f69f14080999 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:48.324403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6f772928-e362-4c9b-ad3d-1fa1ba7b0281 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:48.335047 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6f772928-e362-4c9b-ad3d-1fa1ba7b0281 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1569 microversion: 2.1 time: 0.226727 May 19 12:27:48.335326 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-36632311-f089-4bec-ac1e-d24d8a850a2d req-6d631ce7-261f-4fc6-8425-f69f14080999 service nova] Creating event network-changed:20c5c364-3274-4170-8229-3c010171aa57 for instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 on hv-cinder-80475 May 19 12:27:48.340464 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 459/966] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:48 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:48.341973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-36632311-f089-4bec-ac1e-d24d8a850a2d req-6d631ce7-261f-4fc6-8425-f69f14080999 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034918 May 19 12:27:48.342638 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 508/967] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:48.871891 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b8e5f5cf-4abc-48af-8854-387bbe0ff4c5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:48.872528 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-b8e5f5cf-4abc-48af-8854-387bbe0ff4c5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:48.879028 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b8e5f5cf-4abc-48af-8854-387bbe0ff4c5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:48.879482 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b8e5f5cf-4abc-48af-8854-387bbe0ff4c5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:48.880303 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b8e5f5cf-4abc-48af-8854-387bbe0ff4c5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:48.880736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b8e5f5cf-4abc-48af-8854-387bbe0ff4c5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:49.037090 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b8e5f5cf-4abc-48af-8854-387bbe0ff4c5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:49.046951 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b8e5f5cf-4abc-48af-8854-387bbe0ff4c5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1266 microversion: 2.1 time: 0.179822 May 19 12:27:49.063668 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 460/968] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:48 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:49.322742 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6a934ab0-6ced-4bc2-9572-fb06abdcaa03 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:49.323622 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6a934ab0-6ced-4bc2-9572-fb06abdcaa03 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:49.331346 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a934ab0-6ced-4bc2-9572-fb06abdcaa03 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:49.331825 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a934ab0-6ced-4bc2-9572-fb06abdcaa03 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:49.332620 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a934ab0-6ced-4bc2-9572-fb06abdcaa03 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:49.333059 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a934ab0-6ced-4bc2-9572-fb06abdcaa03 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:49.353145 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6f5662ed-5454-4a5b-a185-abcc37213769 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:49.354161 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6f5662ed-5454-4a5b-a185-abcc37213769 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:49.362276 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6f5662ed-5454-4a5b-a185-abcc37213769 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:49.362942 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6f5662ed-5454-4a5b-a185-abcc37213769 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:49.364056 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6f5662ed-5454-4a5b-a185-abcc37213769 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:49.364799 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6f5662ed-5454-4a5b-a185-abcc37213769 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:49.533361 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6a934ab0-6ced-4bc2-9572-fb06abdcaa03 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:49.544096 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6a934ab0-6ced-4bc2-9572-fb06abdcaa03 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1367 microversion: 2.1 time: 0.225993 May 19 12:27:49.544922 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 509/969] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:49 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:49.572517 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6f5662ed-5454-4a5b-a185-abcc37213769 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:49.581034 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6f5662ed-5454-4a5b-a185-abcc37213769 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1450 microversion: 2.1 time: 0.232501 May 19 12:27:49.582838 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 461/970] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:49 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1450 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:27:50.069554 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1b198365-6757-4f7f-9a7a-8cce75fd4fb2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:50.070202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1b198365-6757-4f7f-9a7a-8cce75fd4fb2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:50.077481 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1b198365-6757-4f7f-9a7a-8cce75fd4fb2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:50.077929 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1b198365-6757-4f7f-9a7a-8cce75fd4fb2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:50.078884 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1b198365-6757-4f7f-9a7a-8cce75fd4fb2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:50.079541 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1b198365-6757-4f7f-9a7a-8cce75fd4fb2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:50.248588 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1b198365-6757-4f7f-9a7a-8cce75fd4fb2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:50.259126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1b198365-6757-4f7f-9a7a-8cce75fd4fb2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1266 microversion: 2.1 time: 0.194131 May 19 12:27:50.259714 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 510/971] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:50 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:50.561878 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-89cba90a-a5bf-4a31-9777-5d9a8339b0da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:50.562498 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-89cba90a-a5bf-4a31-9777-5d9a8339b0da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:50.570195 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-89cba90a-a5bf-4a31-9777-5d9a8339b0da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:50.570707 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-89cba90a-a5bf-4a31-9777-5d9a8339b0da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:50.571522 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-89cba90a-a5bf-4a31-9777-5d9a8339b0da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:50.573682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-89cba90a-a5bf-4a31-9777-5d9a8339b0da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:50.598953 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e402e902-c8e2-499f-b8a5-d52c0d89aafd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:50.599578 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e402e902-c8e2-499f-b8a5-d52c0d89aafd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:50.611560 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e402e902-c8e2-499f-b8a5-d52c0d89aafd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:50.612298 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e402e902-c8e2-499f-b8a5-d52c0d89aafd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:50.614304 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e402e902-c8e2-499f-b8a5-d52c0d89aafd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:50.614304 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e402e902-c8e2-499f-b8a5-d52c0d89aafd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:50.829115 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-89cba90a-a5bf-4a31-9777-5d9a8339b0da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:50.832661 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e402e902-c8e2-499f-b8a5-d52c0d89aafd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:50.841820 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-89cba90a-a5bf-4a31-9777-5d9a8339b0da tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1367 microversion: 2.1 time: 0.282628 May 19 12:27:50.841820 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 462/972] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:50 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:50.842282 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e402e902-c8e2-499f-b8a5-d52c0d89aafd tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1450 microversion: 2.1 time: 0.246730 May 19 12:27:50.851062 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 511/973] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:50 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1450 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:27:51.212557 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-0fdbef02-76d7-4b9b-aa95-ba6d7288b0b8 req-52cb5426-baea-434c-92b2-52d5e6423b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9431305d-b1c8-46c1-9625-0d2e0643174e", "name": "network-vif-deleted", "tag": "d1aaf37f-d3ed-4dc1-91e2-f291ae051dbf"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:51.226098 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-0fdbef02-76d7-4b9b-aa95-ba6d7288b0b8 req-52cb5426-baea-434c-92b2-52d5e6423b83 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:51.231277 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-0fdbef02-76d7-4b9b-aa95-ba6d7288b0b8 req-52cb5426-baea-434c-92b2-52d5e6423b83 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:51.248837 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-0fdbef02-76d7-4b9b-aa95-ba6d7288b0b8 req-52cb5426-baea-434c-92b2-52d5e6423b83 service nova] Creating event network-vif-deleted:d1aaf37f-d3ed-4dc1-91e2-f291ae051dbf for instance 9431305d-b1c8-46c1-9625-0d2e0643174e on hv-cinder-80475 May 19 12:27:51.258558 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-0fdbef02-76d7-4b9b-aa95-ba6d7288b0b8 req-52cb5426-baea-434c-92b2-52d5e6423b83 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049303 May 19 12:27:51.259880 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 463/974] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:51.279872 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5681c550-e5c3-4782-8bed-007c5f4bdf33 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:51.280386 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5681c550-e5c3-4782-8bed-007c5f4bdf33 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:51.287641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5681c550-e5c3-4782-8bed-007c5f4bdf33 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:51.288130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5681c550-e5c3-4782-8bed-007c5f4bdf33 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:51.289188 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5681c550-e5c3-4782-8bed-007c5f4bdf33 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:51.289800 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5681c550-e5c3-4782-8bed-007c5f4bdf33 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:51.440368 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5681c550-e5c3-4782-8bed-007c5f4bdf33 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:51.450405 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5681c550-e5c3-4782-8bed-007c5f4bdf33 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1266 microversion: 2.1 time: 0.175314 May 19 12:27:51.460406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 512/975] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:51 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:51.859529 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-db06d6f4-2058-481e-be91-df9f6db7be4f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:51.861311 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-189065a2-7ecf-440f-b00d-60b54824bdd4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:51.861311 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-189065a2-7ecf-440f-b00d-60b54824bdd4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:51.861851 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-db06d6f4-2058-481e-be91-df9f6db7be4f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:51.866364 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=4 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:51.867118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-189065a2-7ecf-440f-b00d-60b54824bdd4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:51.867576 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-189065a2-7ecf-440f-b00d-60b54824bdd4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:51.868217 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-db06d6f4-2058-481e-be91-df9f6db7be4f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:51.868399 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-189065a2-7ecf-440f-b00d-60b54824bdd4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:51.868666 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-db06d6f4-2058-481e-be91-df9f6db7be4f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:51.868842 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-189065a2-7ecf-440f-b00d-60b54824bdd4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:51.869442 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-db06d6f4-2058-481e-be91-df9f6db7be4f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:51.870780 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-db06d6f4-2058-481e-be91-df9f6db7be4f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:51.888372 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=12 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:52.042850 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-189065a2-7ecf-440f-b00d-60b54824bdd4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:52.050968 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-189065a2-7ecf-440f-b00d-60b54824bdd4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1367 microversion: 2.1 time: 0.196085 May 19 12:27:52.051757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 464/976] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:51 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:52.180198 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-db06d6f4-2058-481e-be91-df9f6db7be4f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:52.182237 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-db06d6f4-2058-481e-be91-df9f6db7be4f tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1220 microversion: 2.1 time: 0.327383 May 19 12:27:52.182853 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 513/977] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:51 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1220 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:52.467696 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f98953e5-545b-4c38-910a-a8061f0f3450 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:52.468356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f98953e5-545b-4c38-910a-a8061f0f3450 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:52.470398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=10 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:52.475537 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f98953e5-545b-4c38-910a-a8061f0f3450 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:52.476034 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f98953e5-545b-4c38-910a-a8061f0f3450 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:52.476831 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f98953e5-545b-4c38-910a-a8061f0f3450 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:52.477278 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f98953e5-545b-4c38-910a-a8061f0f3450 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:52.680732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f98953e5-545b-4c38-910a-a8061f0f3450 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:52.689958 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f98953e5-545b-4c38-910a-a8061f0f3450 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1266 microversion: 2.1 time: 0.226545 May 19 12:27:52.690544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 465/978] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:52 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:53.068876 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2dbb44e3-9481-4041-9392-6d4324b71182 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:53.069501 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2dbb44e3-9481-4041-9392-6d4324b71182 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:53.076921 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2dbb44e3-9481-4041-9392-6d4324b71182 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:53.077373 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2dbb44e3-9481-4041-9392-6d4324b71182 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:53.078149 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2dbb44e3-9481-4041-9392-6d4324b71182 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:53.078684 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2dbb44e3-9481-4041-9392-6d4324b71182 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:53.201416 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a9dd151d-e053-4480-a624-90a3baa8e390 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:53.202194 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a9dd151d-e053-4480-a624-90a3baa8e390 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:53.212751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a9dd151d-e053-4480-a624-90a3baa8e390 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:53.214291 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a9dd151d-e053-4480-a624-90a3baa8e390 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:53.216019 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a9dd151d-e053-4480-a624-90a3baa8e390 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:53.217450 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a9dd151d-e053-4480-a624-90a3baa8e390 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:53.247823 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2dbb44e3-9481-4041-9392-6d4324b71182 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:53.256533 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2dbb44e3-9481-4041-9392-6d4324b71182 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1367 microversion: 2.1 time: 0.191363 May 19 12:27:53.257434 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 514/979] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:53 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:53.311876 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a9dd151d-e053-4480-a624-90a3baa8e390 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:53.325254 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a9dd151d-e053-4480-a624-90a3baa8e390 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1220 microversion: 2.1 time: 0.128689 May 19 12:27:53.325989 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 466/980] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:53 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1220 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:53.708532 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fdf4f6d2-a996-4321-baee-4f5b6bf0b747 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:53.714801 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-fdf4f6d2-a996-4321-baee-4f5b6bf0b747 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:53.716901 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fdf4f6d2-a996-4321-baee-4f5b6bf0b747 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:53.717355 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fdf4f6d2-a996-4321-baee-4f5b6bf0b747 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:53.718265 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fdf4f6d2-a996-4321-baee-4f5b6bf0b747 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:53.718705 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fdf4f6d2-a996-4321-baee-4f5b6bf0b747 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:53.855727 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fdf4f6d2-a996-4321-baee-4f5b6bf0b747 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:53.864276 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fdf4f6d2-a996-4321-baee-4f5b6bf0b747 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1266 microversion: 2.1 time: 0.159852 May 19 12:27:53.864860 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 515/981] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:53 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:54.273823 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-42ea3a92-35e3-4fac-a856-4e892e564bb4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:54.274463 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-42ea3a92-35e3-4fac-a856-4e892e564bb4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:54.282479 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-42ea3a92-35e3-4fac-a856-4e892e564bb4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:54.282933 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-42ea3a92-35e3-4fac-a856-4e892e564bb4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:54.283716 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-42ea3a92-35e3-4fac-a856-4e892e564bb4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:54.284183 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-42ea3a92-35e3-4fac-a856-4e892e564bb4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:54.342701 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-464b9cf7-53c3-477d-8db0-4304d2219255 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:54.343375 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-464b9cf7-53c3-477d-8db0-4304d2219255 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:54.350478 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-464b9cf7-53c3-477d-8db0-4304d2219255 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:54.351143 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-464b9cf7-53c3-477d-8db0-4304d2219255 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:54.352288 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-464b9cf7-53c3-477d-8db0-4304d2219255 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:54.358918 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-464b9cf7-53c3-477d-8db0-4304d2219255 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:54.443235 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-464b9cf7-53c3-477d-8db0-4304d2219255 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:54.453936 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-464b9cf7-53c3-477d-8db0-4304d2219255 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1220 microversion: 2.1 time: 0.115437 May 19 12:27:54.454674 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 516/982] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:54 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1220 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:27:54.476673 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-42ea3a92-35e3-4fac-a856-4e892e564bb4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:54.486159 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-42ea3a92-35e3-4fac-a856-4e892e564bb4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1367 microversion: 2.1 time: 0.216145 May 19 12:27:54.487238 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 467/983] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:54 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:54.882196 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0c120a3f-c37a-4276-abbf-5d283a008395 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:54.882815 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0c120a3f-c37a-4276-abbf-5d283a008395 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:54.886871 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:54.890390 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0c120a3f-c37a-4276-abbf-5d283a008395 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:54.890839 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0c120a3f-c37a-4276-abbf-5d283a008395 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:54.891612 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0c120a3f-c37a-4276-abbf-5d283a008395 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:54.892096 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0c120a3f-c37a-4276-abbf-5d283a008395 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:55.029807 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0c120a3f-c37a-4276-abbf-5d283a008395 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:55.037416 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0c120a3f-c37a-4276-abbf-5d283a008395 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1266 microversion: 2.1 time: 0.159077 May 19 12:27:55.038039 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 517/984] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:54 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:55.471497 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-8c2dd85d-860c-4315-90da-45f84f92e331 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:55.474470 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-8c2dd85d-860c-4315-90da-45f84f92e331 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:55.479596 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8c2dd85d-860c-4315-90da-45f84f92e331 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:55.480343 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8c2dd85d-860c-4315-90da-45f84f92e331 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:55.481139 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8c2dd85d-860c-4315-90da-45f84f92e331 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:55.481575 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8c2dd85d-860c-4315-90da-45f84f92e331 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:55.503967 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-191004c9-125b-4b05-a030-1c9753d586ed tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:55.504697 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-191004c9-125b-4b05-a030-1c9753d586ed tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:55.517047 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-191004c9-125b-4b05-a030-1c9753d586ed tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:55.517899 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-191004c9-125b-4b05-a030-1c9753d586ed tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:55.519079 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-191004c9-125b-4b05-a030-1c9753d586ed tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:55.520460 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-191004c9-125b-4b05-a030-1c9753d586ed tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:55.546556 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8c2dd85d-860c-4315-90da-45f84f92e331 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:55.547007 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8c2dd85d-860c-4315-90da-45f84f92e331 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:55.547630 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.objects.instance [None req-8c2dd85d-860c-4315-90da-45f84f92e331 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lazy-loading 'fault' on Instance uuid 9431305d-b1c8-46c1-9625-0d2e0643174e {{(pid=117964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:27:55.618791 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-8c2dd85d-860c-4315-90da-45f84f92e331 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3124804c65204e9e8dc4c26e572390b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beba4cdb9854497b6cedd3e76059e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:55.628901 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-8c2dd85d-860c-4315-90da-45f84f92e331 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 200 len: 1179 microversion: 2.1 time: 0.162150 May 19 12:27:55.630091 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 468/985] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:55 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 1179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:55.635804 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-bca491d9-a7b4-4012-8317-ccdb9788ae2b req-60a2c5ec-01ee-4224-b569-6376e8b70ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5e1226-df90-46cb-b63b-38a15848fa99", "name": "network-vif-plugged", "status": "completed", "tag": "8f049042-efb1-4f34-b024-4e6aa097edab"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:55.645003 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-bca491d9-a7b4-4012-8317-ccdb9788ae2b req-60a2c5ec-01ee-4224-b569-6376e8b70ac6 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:55.645444 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-bca491d9-a7b4-4012-8317-ccdb9788ae2b req-60a2c5ec-01ee-4224-b569-6376e8b70ac6 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:55.657438 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-bca491d9-a7b4-4012-8317-ccdb9788ae2b req-60a2c5ec-01ee-4224-b569-6376e8b70ac6 service nova] Creating event network-vif-plugged:8f049042-efb1-4f34-b024-4e6aa097edab for instance fd5e1226-df90-46cb-b63b-38a15848fa99 on hv-cinder-80475 May 19 12:27:55.664878 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-bca491d9-a7b4-4012-8317-ccdb9788ae2b req-60a2c5ec-01ee-4224-b569-6376e8b70ac6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033300 May 19 12:27:55.667103 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 469/986] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:55.718630 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-191004c9-125b-4b05-a030-1c9753d586ed tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:55.729944 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-191004c9-125b-4b05-a030-1c9753d586ed tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1367 microversion: 2.1 time: 0.229712 May 19 12:27:55.730845 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 518/987] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:55 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:27:56.055646 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-46a65e05-7653-4a48-bcd0-a970a0412b34 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:56.056374 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-46a65e05-7653-4a48-bcd0-a970a0412b34 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:56.063767 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-46a65e05-7653-4a48-bcd0-a970a0412b34 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:56.063982 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-46a65e05-7653-4a48-bcd0-a970a0412b34 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:56.064768 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-46a65e05-7653-4a48-bcd0-a970a0412b34 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:56.065240 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-46a65e05-7653-4a48-bcd0-a970a0412b34 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:56.210970 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-46a65e05-7653-4a48-bcd0-a970a0412b34 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:56.219515 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-46a65e05-7653-4a48-bcd0-a970a0412b34 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1266 microversion: 2.1 time: 0.168372 May 19 12:27:56.220219 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 470/988] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:56 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:27:56.254139 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:27:56.254389 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Thu May 19 12:27:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:27:56.646527 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3258603c-f678-435f-a436-09888002abd6 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:56.647139 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3258603c-f678-435f-a436-09888002abd6 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] [instance: 9431305d-b1c8-46c1-9625-0d2e0643174e] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:56.654904 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3258603c-f678-435f-a436-09888002abd6 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:56.655352 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3258603c-f678-435f-a436-09888002abd6 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:56.656149 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3258603c-f678-435f-a436-09888002abd6 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:56.656588 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3258603c-f678-435f-a436-09888002abd6 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:56.670749 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-3258603c-f678-435f-a436-09888002abd6 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] HTTP exception thrown: Instance 9431305d-b1c8-46c1-9625-0d2e0643174e could not be found. May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3258603c-f678-435f-a436-09888002abd6 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Request method failure captured: May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e HTTP/1.1 May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjYiRJvgLlJX9w6z05gtTt9IVGDc5LeyQM4-QrbAHBAHeWQgGIcpSrQ_hGxhOczpd-9FVeVfGnqP3GGOfSYNyFdvdfCl6hlNXhyhxvrvX-GpLKi5h61EangA5FnbOjAOHyjVr62dO6h_YweCEp9vLRMF7HY3wuuRDDUgDBtfNyJhZLE May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 0beba4cdb9854497b6cedd3e76059e12 May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-TestShelveInstance-971620300 May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:27:56.672435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:27:56.674035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0beba4cdb9854497b6cedd3e76059e12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0beba4cdb9854497b6cedd3e76059e12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0beba4cdb9854497b6cedd3e76059e12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0beba4cdb9854497b6cedd3e76059e12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:27:56.674035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-TestShelveInstance-971620300 May 19 12:27:56.674035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 0beba4cdb9854497b6cedd3e76059e12 May 19 12:27:56.674035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-TestShelveInstance-971620300 May 19 12:27:56.674035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-TestShelveInstance-971620300-project May 19 12:27:56.674035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:27:56.674035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:27:56.674035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: 3124804c65204e9e8dc4c26e572390b9 May 19 12:27:56.674035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-TestShelveInstance-971620300-project May 19 12:27:56.674035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:27:56.674035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance 9431305d-b1c8-46c1-9625-0d2e0643174e could not be found. May 19 12:27:56.674035 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': '9431305d-b1c8-46c1-9625-0d2e0643174e'} May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9431305d-b1c8-46c1-9625-0d2e0643174e could not be found. May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:27:56.675007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:27:56.676634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:27:56.676634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:27:56.676634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:27:56.676634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:27:56.676634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:27:56.676634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:27:56.676634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:27:56.676634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9431305d-b1c8-46c1-9625-0d2e0643174e could not be found. May 19 12:27:56.676634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:27:56.676634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:27:56.676634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:27:56.676634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:27:56.676634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:27:56.676634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:27:56.676634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:27:56.676634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:27:56.676634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9431305d-b1c8-46c1-9625-0d2e0643174e could not be found. May 19 12:27:56.676634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:27:56.678075 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3258603c-f678-435f-a436-09888002abd6 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Returning 404 to user: Instance 9431305d-b1c8-46c1-9625-0d2e0643174e could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:27:56.678075 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3258603c-f678-435f-a436-09888002abd6 tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e" status: 404 len: 111 microversion: 2.1 time: 0.031454 May 19 12:27:56.678075 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 519/989] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:56 2022] GET /compute/v2.1/servers/9431305d-b1c8-46c1-9625-0d2e0643174e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:27:56.748108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ab6fa966-c6ca-473d-b40b-bf3943cafc74 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:56.748772 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ab6fa966-c6ca-473d-b40b-bf3943cafc74 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:56.755733 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ab6fa966-c6ca-473d-b40b-bf3943cafc74 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:56.756775 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ab6fa966-c6ca-473d-b40b-bf3943cafc74 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:56.757018 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ab6fa966-c6ca-473d-b40b-bf3943cafc74 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:56.757669 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ab6fa966-c6ca-473d-b40b-bf3943cafc74 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:56.894247 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ab6fa966-c6ca-473d-b40b-bf3943cafc74 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:56.901982 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ab6fa966-c6ca-473d-b40b-bf3943cafc74 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1367 microversion: 2.1 time: 0.158904 May 19 12:27:56.902554 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 471/990] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:56 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:57.060435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d34cc20e-f857-4c7c-b788-070ca3f3311e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] Calling method '.version_select at 0x7f3b9d958790>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:57.168271 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d34cc20e-f857-4c7c-b788-070ca3f3311e tempest-TestShelveInstance-971620300 tempest-TestShelveInstance-971620300-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1388952173" status: 202 len: 0 microversion: 2.1 time: 0.120011 May 19 12:27:57.168852 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 520/991] 10.222.0.23 () {58 vars in 1253 bytes} [Thu May 19 12:27:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1388952173 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:27:57.238397 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-16b0633e-f66d-4ba7-980d-618ceabc4c70 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:57.239023 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-16b0633e-f66d-4ba7-980d-618ceabc4c70 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:57.246132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-16b0633e-f66d-4ba7-980d-618ceabc4c70 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:57.246434 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-16b0633e-f66d-4ba7-980d-618ceabc4c70 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:57.247216 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-16b0633e-f66d-4ba7-980d-618ceabc4c70 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:57.247830 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-16b0633e-f66d-4ba7-980d-618ceabc4c70 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:57.398740 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-16b0633e-f66d-4ba7-980d-618ceabc4c70 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:57.409394 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-16b0633e-f66d-4ba7-980d-618ceabc4c70 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1266 microversion: 2.1 time: 0.175206 May 19 12:27:57.419831 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 472/992] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:57 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:57.679727 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-40d9f04a-3373-4756-b6b9-76076357def7 req-bb0863dc-635d-4188-b11d-f031e6d75e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4044bf22-d9bc-4d48-b10d-7ad3da39ebd7", "name": "network-vif-plugged", "status": "completed", "tag": "20c5c364-3274-4170-8229-3c010171aa57"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:57.690026 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-40d9f04a-3373-4756-b6b9-76076357def7 req-bb0863dc-635d-4188-b11d-f031e6d75e23 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:57.690479 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-40d9f04a-3373-4756-b6b9-76076357def7 req-bb0863dc-635d-4188-b11d-f031e6d75e23 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:57.702626 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-40d9f04a-3373-4756-b6b9-76076357def7 req-bb0863dc-635d-4188-b11d-f031e6d75e23 service nova] Creating event network-vif-plugged:20c5c364-3274-4170-8229-3c010171aa57 for instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 on hv-cinder-80475 May 19 12:27:57.708433 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-40d9f04a-3373-4756-b6b9-76076357def7 req-bb0863dc-635d-4188-b11d-f031e6d75e23 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032382 May 19 12:27:57.709103 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 521/993] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:57.919575 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5f7f44f3-6039-4ccc-bb1a-a10181305053 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:57.920443 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5f7f44f3-6039-4ccc-bb1a-a10181305053 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:57.922984 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:57.930676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5f7f44f3-6039-4ccc-bb1a-a10181305053 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:57.931491 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5f7f44f3-6039-4ccc-bb1a-a10181305053 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:57.934216 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5f7f44f3-6039-4ccc-bb1a-a10181305053 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:57.935017 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5f7f44f3-6039-4ccc-bb1a-a10181305053 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:58.088061 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5f7f44f3-6039-4ccc-bb1a-a10181305053 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:58.096671 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5f7f44f3-6039-4ccc-bb1a-a10181305053 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1367 microversion: 2.1 time: 0.181637 May 19 12:27:58.097249 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 473/994] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:57 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:27:58.429912 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6a4b1bba-484b-49ad-aa11-3232d6570513 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:58.430938 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6a4b1bba-484b-49ad-aa11-3232d6570513 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:58.440106 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a4b1bba-484b-49ad-aa11-3232d6570513 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:58.444285 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a4b1bba-484b-49ad-aa11-3232d6570513 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:58.444285 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a4b1bba-484b-49ad-aa11-3232d6570513 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:58.444285 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a4b1bba-484b-49ad-aa11-3232d6570513 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:58.611127 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6a4b1bba-484b-49ad-aa11-3232d6570513 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:58.625266 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6a4b1bba-484b-49ad-aa11-3232d6570513 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1454 microversion: 2.1 time: 0.199789 May 19 12:27:58.626008 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 522/995] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:58 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1454 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:58.644934 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-97feee0b-5c18-4c43-a222-ef6a8826c9f0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:58.645777 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-97feee0b-5c18-4c43-a222-ef6a8826c9f0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:58.653894 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-97feee0b-5c18-4c43-a222-ef6a8826c9f0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:58.659380 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-97feee0b-5c18-4c43-a222-ef6a8826c9f0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:58.659380 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-97feee0b-5c18-4c43-a222-ef6a8826c9f0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:58.659380 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-97feee0b-5c18-4c43-a222-ef6a8826c9f0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:58.660489 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=100 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:58.813750 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-97feee0b-5c18-4c43-a222-ef6a8826c9f0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:58.822138 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-97feee0b-5c18-4c43-a222-ef6a8826c9f0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1454 microversion: 2.1 time: 0.181380 May 19 12:27:58.823238 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 474/996] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:58 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1454 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:59.114546 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6e070429-c675-4466-a411-5e5e27e7a7d8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:59.115272 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6e070429-c675-4466-a411-5e5e27e7a7d8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:59.122592 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6e070429-c675-4466-a411-5e5e27e7a7d8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:59.123144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6e070429-c675-4466-a411-5e5e27e7a7d8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:59.123973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6e070429-c675-4466-a411-5e5e27e7a7d8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:59.124418 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6e070429-c675-4466-a411-5e5e27e7a7d8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:59.358913 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6e070429-c675-4466-a411-5e5e27e7a7d8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:59.375825 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6e070429-c675-4466-a411-5e5e27e7a7d8 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1367 microversion: 2.1 time: 0.264737 May 19 12:27:59.377325 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 523/997] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:27:59 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:59.914445 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-320cc0a5-4904-455d-8583-67f58267d4a3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:59.915654 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-320cc0a5-4904-455d-8583-67f58267d4a3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:59.923353 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-320cc0a5-4904-455d-8583-67f58267d4a3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:59.925051 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-320cc0a5-4904-455d-8583-67f58267d4a3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:59.929047 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-320cc0a5-4904-455d-8583-67f58267d4a3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:59.929047 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-320cc0a5-4904-455d-8583-67f58267d4a3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:59.955461 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-320cc0a5-4904-455d-8583-67f58267d4a3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/ips" status: 200 len: 146 microversion: 2.1 time: 0.044902 May 19 12:27:59.958507 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 475/998] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 19 12:27:59 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/ips => generated 146 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:00.395917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2564cf95-68a2-46d5-87d2-529fd1481860 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:00.397062 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2564cf95-68a2-46d5-87d2-529fd1481860 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:00.405962 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2564cf95-68a2-46d5-87d2-529fd1481860 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:00.406413 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2564cf95-68a2-46d5-87d2-529fd1481860 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:00.407435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2564cf95-68a2-46d5-87d2-529fd1481860 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:00.408397 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2564cf95-68a2-46d5-87d2-529fd1481860 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:00.703284 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2564cf95-68a2-46d5-87d2-529fd1481860 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:00.711564 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2564cf95-68a2-46d5-87d2-529fd1481860 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1367 microversion: 2.1 time: 0.320775 May 19 12:28:00.712984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 524/999] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:28:00 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:01.729815 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-37b5df26-3ad6-4a0b-b093-77ab9e6f0205 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:01.730440 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-37b5df26-3ad6-4a0b-b093-77ab9e6f0205 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:01.740574 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-37b5df26-3ad6-4a0b-b093-77ab9e6f0205 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:01.741097 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-37b5df26-3ad6-4a0b-b093-77ab9e6f0205 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:01.743891 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-37b5df26-3ad6-4a0b-b093-77ab9e6f0205 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:01.743891 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-37b5df26-3ad6-4a0b-b093-77ab9e6f0205 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:01.938378 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-93653221-ba23-4cc9-8e4d-9448cab604d3 req-7d07e076-839c-465c-8662-76e7471baaa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5e1226-df90-46cb-b63b-38a15848fa99", "tag": "8f049042-efb1-4f34-b024-4e6aa097edab"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:01.958845 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-37b5df26-3ad6-4a0b-b093-77ab9e6f0205 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:01.959960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-93653221-ba23-4cc9-8e4d-9448cab604d3 req-7d07e076-839c-465c-8662-76e7471baaa4 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:01.959960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-93653221-ba23-4cc9-8e4d-9448cab604d3 req-7d07e076-839c-465c-8662-76e7471baaa4 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:01.965137 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-37b5df26-3ad6-4a0b-b093-77ab9e6f0205 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1557 microversion: 2.1 time: 0.239350 May 19 12:28:01.965878 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 476/1000] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:28:01 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1557 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:01.987719 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-93653221-ba23-4cc9-8e4d-9448cab604d3 req-7d07e076-839c-465c-8662-76e7471baaa4 service nova] Creating event network-changed:8f049042-efb1-4f34-b024-4e6aa097edab for instance fd5e1226-df90-46cb-b63b-38a15848fa99 on hv-cinder-80475 May 19 12:28:01.988211 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-7594f862-baa7-4b02-9e12-bd29ad7e7dfd tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:01.988939 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-7594f862-baa7-4b02-9e12-bd29ad7e7dfd tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:01.996032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-93653221-ba23-4cc9-8e4d-9448cab604d3 req-7d07e076-839c-465c-8662-76e7471baaa4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061334 May 19 12:28:02.000155 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7594f862-baa7-4b02-9e12-bd29ad7e7dfd tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:02.000683 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7594f862-baa7-4b02-9e12-bd29ad7e7dfd tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:02.001580 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7594f862-baa7-4b02-9e12-bd29ad7e7dfd tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:02.002114 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7594f862-baa7-4b02-9e12-bd29ad7e7dfd tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:02.007968 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 525/1001] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:02.116330 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-7594f862-baa7-4b02-9e12-bd29ad7e7dfd tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134286 May 19 12:28:02.117292 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 477/1002] 10.222.0.23 () {58 vars in 1274 bytes} [Thu May 19 12:28:01 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:02.719920 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-da36ea73-8da8-4232-8225-df340da8d8a4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3dd5e97c-a417-4508-a10e-4b5df306db22"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:02.721209 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-da36ea73-8da8-4232-8225-df340da8d8a4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:02.741143 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-da36ea73-8da8-4232-8225-df340da8d8a4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:02.741837 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-da36ea73-8da8-4232-8225-df340da8d8a4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:02.742838 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-da36ea73-8da8-4232-8225-df340da8d8a4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:02.743478 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-da36ea73-8da8-4232-8225-df340da8d8a4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:03.011662 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:03.801426 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-da36ea73-8da8-4232-8225-df340da8d8a4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "POST /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.085579 May 19 12:28:03.802854 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 526/1003] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 19 12:28:02 2022] POST /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments => generated 194 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:04.013306 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-b8ff20e4-867b-4669-90ea-f34c423e6168 req-fcc1d12a-0d58-4ad1-a66c-c726e5fb7f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4044bf22-d9bc-4d48-b10d-7ad3da39ebd7", "tag": "20c5c364-3274-4170-8229-3c010171aa57"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:04.022790 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-b8ff20e4-867b-4669-90ea-f34c423e6168 req-fcc1d12a-0d58-4ad1-a66c-c726e5fb7f6b service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:04.023242 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-b8ff20e4-867b-4669-90ea-f34c423e6168 req-fcc1d12a-0d58-4ad1-a66c-c726e5fb7f6b service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:04.052162 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-b8ff20e4-867b-4669-90ea-f34c423e6168 req-fcc1d12a-0d58-4ad1-a66c-c726e5fb7f6b service nova] Creating event network-changed:20c5c364-3274-4170-8229-3c010171aa57 for instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 on hv-cinder-80475 May 19 12:28:04.065975 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-b8ff20e4-867b-4669-90ea-f34c423e6168 req-fcc1d12a-0d58-4ad1-a66c-c726e5fb7f6b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057818 May 19 12:28:04.066583 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 478/1004] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:04.987014 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e6c46de0-4abb-4f40-a2ad-9b5d90bfdffe tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:04.987687 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e6c46de0-4abb-4f40-a2ad-9b5d90bfdffe tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:04.994759 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e6c46de0-4abb-4f40-a2ad-9b5d90bfdffe tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:04.995295 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e6c46de0-4abb-4f40-a2ad-9b5d90bfdffe tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:04.996222 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e6c46de0-4abb-4f40-a2ad-9b5d90bfdffe tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:04.997254 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e6c46de0-4abb-4f40-a2ad-9b5d90bfdffe tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:05.025334 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e6c46de0-4abb-4f40-a2ad-9b5d90bfdffe tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec/ips" status: 200 len: 152 microversion: 2.20 time: 0.043109 May 19 12:28:05.026998 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 527/1005] 10.222.0.23 () {60 vars in 1288 bytes} [Thu May 19 12:28:04 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:28:11.412008 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-48713de3-5df5-4127-8740-519fda27e57e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:11.412731 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-48713de3-5df5-4127-8740-519fda27e57e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:11.420795 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-48713de3-5df5-4127-8740-519fda27e57e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:11.421609 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-48713de3-5df5-4127-8740-519fda27e57e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:11.422032 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-48713de3-5df5-4127-8740-519fda27e57e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:11.422473 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-48713de3-5df5-4127-8740-519fda27e57e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:11.445738 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.objects.instance [None req-48713de3-5df5-4127-8740-519fda27e57e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lazy-loading 'flavor' on Instance uuid 315fa402-5c50-4d9d-bfba-b2e39a9133ec {{(pid=117964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:28:12.149112 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-48713de3-5df5-4127-8740-519fda27e57e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "POST /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec/action" status: 202 len: 0 microversion: 2.20 time: 0.741331 May 19 12:28:12.149893 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 479/1006] 10.222.0.23 () {62 vars in 1318 bytes} [Thu May 19 12:28:11 2022] POST /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec/action => generated 0 bytes in 743 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 12:28:12.158550 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-88a4f3db-8a61-4a4f-9865-01d4473263d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:12.159222 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-88a4f3db-8a61-4a4f-9865-01d4473263d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:12.168991 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-88a4f3db-8a61-4a4f-9865-01d4473263d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:12.173061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-88a4f3db-8a61-4a4f-9865-01d4473263d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:12.173061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-88a4f3db-8a61-4a4f-9865-01d4473263d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:12.173061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-88a4f3db-8a61-4a4f-9865-01d4473263d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:12.318314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-88a4f3db-8a61-4a4f-9865-01d4473263d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:12.332940 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-88a4f3db-8a61-4a4f-9865-01d4473263d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:12.339303 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-88a4f3db-8a61-4a4f-9865-01d4473263d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:12.339303 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-88a4f3db-8a61-4a4f-9865-01d4473263d5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1722 microversion: 2.20 time: 0.183242 May 19 12:28:12.339303 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 528/1007] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:12 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:13.358628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ea3542de-a970-4ac1-9940-cf1399a80b68 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:13.359338 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ea3542de-a970-4ac1-9940-cf1399a80b68 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:13.366224 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ea3542de-a970-4ac1-9940-cf1399a80b68 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:13.366687 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ea3542de-a970-4ac1-9940-cf1399a80b68 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:13.373547 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ea3542de-a970-4ac1-9940-cf1399a80b68 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:13.373547 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ea3542de-a970-4ac1-9940-cf1399a80b68 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:13.502977 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ea3542de-a970-4ac1-9940-cf1399a80b68 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:13.511826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ea3542de-a970-4ac1-9940-cf1399a80b68 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:13.513389 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ea3542de-a970-4ac1-9940-cf1399a80b68 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:13.514595 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ea3542de-a970-4ac1-9940-cf1399a80b68 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1722 microversion: 2.20 time: 0.161654 May 19 12:28:13.515146 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 480/1008] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:13 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:14.532756 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1a48ab88-11f5-409e-9220-4f6255e7d78f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:14.533357 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1a48ab88-11f5-409e-9220-4f6255e7d78f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:14.540255 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1a48ab88-11f5-409e-9220-4f6255e7d78f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:14.540713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1a48ab88-11f5-409e-9220-4f6255e7d78f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:14.541714 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1a48ab88-11f5-409e-9220-4f6255e7d78f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:14.542277 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1a48ab88-11f5-409e-9220-4f6255e7d78f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:14.680326 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1a48ab88-11f5-409e-9220-4f6255e7d78f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:14.690133 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1a48ab88-11f5-409e-9220-4f6255e7d78f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:14.691647 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1a48ab88-11f5-409e-9220-4f6255e7d78f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:14.693093 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1a48ab88-11f5-409e-9220-4f6255e7d78f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1722 microversion: 2.20 time: 0.164262 May 19 12:28:14.693883 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 529/1009] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:14 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:28:15.615611 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-cb9631ce-bf43-4a56-a947-08a044d8d2b3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:15.616641 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-cb9631ce-bf43-4a56-a947-08a044d8d2b3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:15.624410 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-cb9631ce-bf43-4a56-a947-08a044d8d2b3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:15.624759 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-cb9631ce-bf43-4a56-a947-08a044d8d2b3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:15.625545 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-cb9631ce-bf43-4a56-a947-08a044d8d2b3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:15.626111 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-cb9631ce-bf43-4a56-a947-08a044d8d2b3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:15.658172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-cb9631ce-bf43-4a56-a947-08a044d8d2b3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046471 May 19 12:28:15.658730 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 481/1010] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:28:15 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:15.669191 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a12f37b7-21b0-4254-9166-0af6253f6d73 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:15.669729 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a12f37b7-21b0-4254-9166-0af6253f6d73 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:15.676249 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a12f37b7-21b0-4254-9166-0af6253f6d73 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:15.676695 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a12f37b7-21b0-4254-9166-0af6253f6d73 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:15.677455 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a12f37b7-21b0-4254-9166-0af6253f6d73 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:15.677888 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a12f37b7-21b0-4254-9166-0af6253f6d73 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:15.707943 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a12f37b7-21b0-4254-9166-0af6253f6d73 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments/3dd5e97c-a417-4508-a10e-4b5df306db22" status: 200 len: 194 microversion: 2.1 time: 0.043031 May 19 12:28:15.712994 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 530/1011] 10.222.0.23 () {58 vars in 1412 bytes} [Thu May 19 12:28:15 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments/3dd5e97c-a417-4508-a10e-4b5df306db22 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:15.713805 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e522c216-a819-4d93-b18a-b0e0ebf0e81c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:15.713906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e522c216-a819-4d93-b18a-b0e0ebf0e81c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:15.724797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e522c216-a819-4d93-b18a-b0e0ebf0e81c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:15.724797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e522c216-a819-4d93-b18a-b0e0ebf0e81c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:15.724797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e522c216-a819-4d93-b18a-b0e0ebf0e81c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:15.724797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e522c216-a819-4d93-b18a-b0e0ebf0e81c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:15.858104 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e522c216-a819-4d93-b18a-b0e0ebf0e81c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:15.866483 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e522c216-a819-4d93-b18a-b0e0ebf0e81c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:15.868014 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e522c216-a819-4d93-b18a-b0e0ebf0e81c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:15.869179 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e522c216-a819-4d93-b18a-b0e0ebf0e81c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1722 microversion: 2.20 time: 0.160166 May 19 12:28:15.869731 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 482/1012] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:15 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:28:16.887969 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c19c676e-08ce-49bd-a4c8-b49739b66b6d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:16.888584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c19c676e-08ce-49bd-a4c8-b49739b66b6d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:16.895158 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c19c676e-08ce-49bd-a4c8-b49739b66b6d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:16.895612 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c19c676e-08ce-49bd-a4c8-b49739b66b6d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:16.896443 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c19c676e-08ce-49bd-a4c8-b49739b66b6d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:16.896868 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c19c676e-08ce-49bd-a4c8-b49739b66b6d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:17.045179 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c19c676e-08ce-49bd-a4c8-b49739b66b6d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:17.054182 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c19c676e-08ce-49bd-a4c8-b49739b66b6d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:17.055868 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c19c676e-08ce-49bd-a4c8-b49739b66b6d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:17.057704 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c19c676e-08ce-49bd-a4c8-b49739b66b6d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1722 microversion: 2.20 time: 0.174328 May 19 12:28:17.058446 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 531/1013] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:16 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:28:18.076343 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-af4ffeb3-6ed5-42b4-94f0-1eeb1eabc10d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:18.076948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-af4ffeb3-6ed5-42b4-94f0-1eeb1eabc10d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:18.084620 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-af4ffeb3-6ed5-42b4-94f0-1eeb1eabc10d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:18.085002 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-af4ffeb3-6ed5-42b4-94f0-1eeb1eabc10d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:18.085780 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-af4ffeb3-6ed5-42b4-94f0-1eeb1eabc10d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:18.086216 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-af4ffeb3-6ed5-42b4-94f0-1eeb1eabc10d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:18.222404 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-af4ffeb3-6ed5-42b4-94f0-1eeb1eabc10d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:18.231557 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-af4ffeb3-6ed5-42b4-94f0-1eeb1eabc10d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:18.233330 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-af4ffeb3-6ed5-42b4-94f0-1eeb1eabc10d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:18.234497 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-af4ffeb3-6ed5-42b4-94f0-1eeb1eabc10d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1722 microversion: 2.20 time: 0.162326 May 19 12:28:18.235436 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 483/1014] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:18 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:18.685204 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-66f1b685-b2c9-437c-b688-bfe008bdfce8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "651e51f4-d93f-49cf-bc4f-c3312536e81a"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:18.686552 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-66f1b685-b2c9-437c-b688-bfe008bdfce8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:18.693275 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66f1b685-b2c9-437c-b688-bfe008bdfce8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:18.693811 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66f1b685-b2c9-437c-b688-bfe008bdfce8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:18.694553 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66f1b685-b2c9-437c-b688-bfe008bdfce8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:18.694997 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66f1b685-b2c9-437c-b688-bfe008bdfce8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:19.254709 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-23d09911-5818-446f-9d19-75fbff1a1888 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:19.255261 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-23d09911-5818-446f-9d19-75fbff1a1888 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:19.262979 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-23d09911-5818-446f-9d19-75fbff1a1888 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:19.263585 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-23d09911-5818-446f-9d19-75fbff1a1888 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:19.264398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-23d09911-5818-446f-9d19-75fbff1a1888 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:19.264833 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-23d09911-5818-446f-9d19-75fbff1a1888 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:19.420547 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-23d09911-5818-446f-9d19-75fbff1a1888 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:19.429123 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-23d09911-5818-446f-9d19-75fbff1a1888 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:19.430639 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-23d09911-5818-446f-9d19-75fbff1a1888 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:19.432420 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-23d09911-5818-446f-9d19-75fbff1a1888 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1722 microversion: 2.20 time: 0.181178 May 19 12:28:19.433079 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 484/1015] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:19 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:28:19.748886 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-66f1b685-b2c9-437c-b688-bfe008bdfce8 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "POST /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.067352 May 19 12:28:19.755888 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 532/1016] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 19 12:28:18 2022] POST /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments => generated 194 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:20.451576 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-1a1d3813-4ed8-4d9e-a64c-c01b23e7eb52 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:20.452288 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-1a1d3813-4ed8-4d9e-a64c-c01b23e7eb52 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:20.460195 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1a1d3813-4ed8-4d9e-a64c-c01b23e7eb52 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:20.460650 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1a1d3813-4ed8-4d9e-a64c-c01b23e7eb52 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:20.461429 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1a1d3813-4ed8-4d9e-a64c-c01b23e7eb52 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:20.461869 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1a1d3813-4ed8-4d9e-a64c-c01b23e7eb52 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:20.606768 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-1a1d3813-4ed8-4d9e-a64c-c01b23e7eb52 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:20.615254 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-1a1d3813-4ed8-4d9e-a64c-c01b23e7eb52 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:20.616834 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-1a1d3813-4ed8-4d9e-a64c-c01b23e7eb52 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:20.618038 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-1a1d3813-4ed8-4d9e-a64c-c01b23e7eb52 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1722 microversion: 2.20 time: 0.170993 May 19 12:28:20.618593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 485/1017] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:20 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:21.639301 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-13232200-d203-45ff-914f-a4a35320dee4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:21.640064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-13232200-d203-45ff-914f-a4a35320dee4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:21.646539 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-13232200-d203-45ff-914f-a4a35320dee4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:21.647011 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-13232200-d203-45ff-914f-a4a35320dee4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:21.647800 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-13232200-d203-45ff-914f-a4a35320dee4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:21.648245 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-13232200-d203-45ff-914f-a4a35320dee4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:21.786258 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-13232200-d203-45ff-914f-a4a35320dee4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:21.794926 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-13232200-d203-45ff-914f-a4a35320dee4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:21.801795 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-13232200-d203-45ff-914f-a4a35320dee4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:21.801795 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-13232200-d203-45ff-914f-a4a35320dee4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1722 microversion: 2.20 time: 0.163867 May 19 12:28:21.801795 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 533/1018] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:21 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:22.816526 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9993741d-63df-481f-b8b8-27db14a98cb7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:22.817135 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9993741d-63df-481f-b8b8-27db14a98cb7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:22.824769 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9993741d-63df-481f-b8b8-27db14a98cb7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:22.825223 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9993741d-63df-481f-b8b8-27db14a98cb7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:22.826155 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9993741d-63df-481f-b8b8-27db14a98cb7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:22.826595 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9993741d-63df-481f-b8b8-27db14a98cb7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:22.972277 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9993741d-63df-481f-b8b8-27db14a98cb7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:22.981449 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9993741d-63df-481f-b8b8-27db14a98cb7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:22.982962 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9993741d-63df-481f-b8b8-27db14a98cb7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:22.984158 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9993741d-63df-481f-b8b8-27db14a98cb7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1722 microversion: 2.20 time: 0.171667 May 19 12:28:22.984715 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 486/1019] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:22 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:24.004050 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5c05366e-aa64-417d-8a77-d010f89021e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:24.004612 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5c05366e-aa64-417d-8a77-d010f89021e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:24.011862 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c05366e-aa64-417d-8a77-d010f89021e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:24.012311 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c05366e-aa64-417d-8a77-d010f89021e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:24.013084 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c05366e-aa64-417d-8a77-d010f89021e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:24.013516 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c05366e-aa64-417d-8a77-d010f89021e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:24.157621 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5c05366e-aa64-417d-8a77-d010f89021e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:24.166013 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5c05366e-aa64-417d-8a77-d010f89021e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:24.168272 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5c05366e-aa64-417d-8a77-d010f89021e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:24.169828 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5c05366e-aa64-417d-8a77-d010f89021e9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1722 microversion: 2.20 time: 0.169839 May 19 12:28:24.170740 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 534/1020] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:23 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:25.188889 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5e3ecbc5-e480-4b50-b05f-ae7fc14fb13c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:25.189554 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5e3ecbc5-e480-4b50-b05f-ae7fc14fb13c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:25.196421 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5e3ecbc5-e480-4b50-b05f-ae7fc14fb13c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:25.196882 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5e3ecbc5-e480-4b50-b05f-ae7fc14fb13c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:25.197686 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5e3ecbc5-e480-4b50-b05f-ae7fc14fb13c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:25.198241 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5e3ecbc5-e480-4b50-b05f-ae7fc14fb13c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:25.344511 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5e3ecbc5-e480-4b50-b05f-ae7fc14fb13c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:25.353037 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5e3ecbc5-e480-4b50-b05f-ae7fc14fb13c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:25.355388 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5e3ecbc5-e480-4b50-b05f-ae7fc14fb13c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:25.356609 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5e3ecbc5-e480-4b50-b05f-ae7fc14fb13c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1743 microversion: 2.20 time: 0.171691 May 19 12:28:25.357172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 487/1021] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:25 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:26.375939 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-53ba25fe-66fb-4a57-b1bd-987634958240 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:26.376543 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-53ba25fe-66fb-4a57-b1bd-987634958240 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:26.383698 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-53ba25fe-66fb-4a57-b1bd-987634958240 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:26.384130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-53ba25fe-66fb-4a57-b1bd-987634958240 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:26.385492 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-53ba25fe-66fb-4a57-b1bd-987634958240 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:26.386134 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-53ba25fe-66fb-4a57-b1bd-987634958240 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:26.564400 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-53ba25fe-66fb-4a57-b1bd-987634958240 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:26.573666 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-53ba25fe-66fb-4a57-b1bd-987634958240 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:26.575306 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-53ba25fe-66fb-4a57-b1bd-987634958240 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:26.576554 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-53ba25fe-66fb-4a57-b1bd-987634958240 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1743 microversion: 2.20 time: 0.204683 May 19 12:28:26.578961 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 535/1022] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:26 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1743 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:27.598753 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-8c5d9792-10aa-4fb6-9dbf-c60e16bcf88c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:27.599671 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-8c5d9792-10aa-4fb6-9dbf-c60e16bcf88c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:27.607198 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8c5d9792-10aa-4fb6-9dbf-c60e16bcf88c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:27.607664 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8c5d9792-10aa-4fb6-9dbf-c60e16bcf88c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:27.608515 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8c5d9792-10aa-4fb6-9dbf-c60e16bcf88c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:27.608964 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8c5d9792-10aa-4fb6-9dbf-c60e16bcf88c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:27.756287 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-8c5d9792-10aa-4fb6-9dbf-c60e16bcf88c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:27.764726 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-8c5d9792-10aa-4fb6-9dbf-c60e16bcf88c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:27.766322 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-8c5d9792-10aa-4fb6-9dbf-c60e16bcf88c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:27.767501 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-8c5d9792-10aa-4fb6-9dbf-c60e16bcf88c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1743 microversion: 2.20 time: 0.172810 May 19 12:28:27.768109 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 488/1023] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:27 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1743 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:28.786877 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-cfb6fac5-117d-4c98-919d-5c7a47317978 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:28.787593 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-cfb6fac5-117d-4c98-919d-5c7a47317978 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:28.790384 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:28.796328 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cfb6fac5-117d-4c98-919d-5c7a47317978 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:28.796787 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cfb6fac5-117d-4c98-919d-5c7a47317978 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:28.797571 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cfb6fac5-117d-4c98-919d-5c7a47317978 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:28.798013 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cfb6fac5-117d-4c98-919d-5c7a47317978 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:28.958567 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-cfb6fac5-117d-4c98-919d-5c7a47317978 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:28.969785 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-cfb6fac5-117d-4c98-919d-5c7a47317978 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:28.971643 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-cfb6fac5-117d-4c98-919d-5c7a47317978 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:28.973438 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-cfb6fac5-117d-4c98-919d-5c7a47317978 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1743 microversion: 2.20 time: 0.190292 May 19 12:28:28.974200 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 536/1024] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:28 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1743 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:28:29.161015 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-1e56acbe-3282-4245-8d4e-a83558f0b4e9 req-46880029-9a65-4347-b4c4-4a1a3e8cf8dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315fa402-5c50-4d9d-bfba-b2e39a9133ec", "name": "network-vif-plugged", "status": "completed", "tag": "60a88c1e-75f6-4fbf-9da2-da492fbaa3ed"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:29.168798 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=32 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:29.181196 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-1e56acbe-3282-4245-8d4e-a83558f0b4e9 req-46880029-9a65-4347-b4c4-4a1a3e8cf8dc service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:29.181196 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-1e56acbe-3282-4245-8d4e-a83558f0b4e9 req-46880029-9a65-4347-b4c4-4a1a3e8cf8dc service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:29.187315 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:29.202629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-1e56acbe-3282-4245-8d4e-a83558f0b4e9 req-46880029-9a65-4347-b4c4-4a1a3e8cf8dc service nova] Creating event network-vif-plugged:60a88c1e-75f6-4fbf-9da2-da492fbaa3ed for instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec on hv-cinder-80475 May 19 12:28:29.211573 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-1e56acbe-3282-4245-8d4e-a83558f0b4e9 req-46880029-9a65-4347-b4c4-4a1a3e8cf8dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057282 May 19 12:28:29.212582 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 489/1025] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:29.467177 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-782cc2dd-0949-4374-b563-6d4106fcae09 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:29.468278 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-782cc2dd-0949-4374-b563-6d4106fcae09 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:29.474766 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-782cc2dd-0949-4374-b563-6d4106fcae09 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:29.475218 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-782cc2dd-0949-4374-b563-6d4106fcae09 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:29.476029 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-782cc2dd-0949-4374-b563-6d4106fcae09 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:29.476466 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-782cc2dd-0949-4374-b563-6d4106fcae09 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:29.516347 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-782cc2dd-0949-4374-b563-6d4106fcae09 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054154 May 19 12:28:29.517119 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 537/1026] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:28:29 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:29.671550 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6fdcdc4c-3d23-4391-a592-e2cea1f4fa57 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:29.672225 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6fdcdc4c-3d23-4391-a592-e2cea1f4fa57 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:29.679454 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6fdcdc4c-3d23-4391-a592-e2cea1f4fa57 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:29.679926 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6fdcdc4c-3d23-4391-a592-e2cea1f4fa57 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:29.680844 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6fdcdc4c-3d23-4391-a592-e2cea1f4fa57 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:29.681349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6fdcdc4c-3d23-4391-a592-e2cea1f4fa57 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:29.714625 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6fdcdc4c-3d23-4391-a592-e2cea1f4fa57 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments/3dd5e97c-a417-4508-a10e-4b5df306db22" status: 200 len: 194 microversion: 2.1 time: 0.048460 May 19 12:28:29.715264 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 490/1027] 10.222.0.23 () {58 vars in 1412 bytes} [Thu May 19 12:28:29 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments/3dd5e97c-a417-4508-a10e-4b5df306db22 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:28:29.733468 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6e8b2158-5234-4538-86b1-8e2e4933705b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:29.734352 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6e8b2158-5234-4538-86b1-8e2e4933705b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:29.746810 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6e8b2158-5234-4538-86b1-8e2e4933705b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:29.747608 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6e8b2158-5234-4538-86b1-8e2e4933705b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:29.749003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6e8b2158-5234-4538-86b1-8e2e4933705b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:29.749735 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6e8b2158-5234-4538-86b1-8e2e4933705b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:29.864214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-6e8b2158-5234-4538-86b1-8e2e4933705b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lazy-loading 'services' on Instance uuid 3447311f-fa45-4fe9-bdf8-d9b88c27356f {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:28:29.995575 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5948357a-caed-4d56-b635-5b5f215465a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:30.008011 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5948357a-caed-4d56-b635-5b5f215465a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:30.008011 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5948357a-caed-4d56-b635-5b5f215465a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:30.008011 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5948357a-caed-4d56-b635-5b5f215465a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:30.008011 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5948357a-caed-4d56-b635-5b5f215465a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:30.008725 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5948357a-caed-4d56-b635-5b5f215465a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:30.199015 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5948357a-caed-4d56-b635-5b5f215465a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:30.199015 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5948357a-caed-4d56-b635-5b5f215465a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:30.199918 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5948357a-caed-4d56-b635-5b5f215465a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:30.200365 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5948357a-caed-4d56-b635-5b5f215465a9 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1743 microversion: 2.20 time: 0.209507 May 19 12:28:30.201048 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 491/1028] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:29 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1743 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:28:30.440056 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6e8b2158-5234-4538-86b1-8e2e4933705b tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments/3dd5e97c-a417-4508-a10e-4b5df306db22" status: 202 len: 0 microversion: 2.1 time: 0.715547 May 19 12:28:30.440892 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 538/1029] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 19 12:28:29 2022] DELETE /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments/3dd5e97c-a417-4508-a10e-4b5df306db22 => generated 0 bytes in 718 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:28:31.223974 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-de24d49f-7af4-4b67-b767-215dae80bacd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:31.225051 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-de24d49f-7af4-4b67-b767-215dae80bacd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:31.238967 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-de24d49f-7af4-4b67-b767-215dae80bacd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:31.268945 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-de24d49f-7af4-4b67-b767-215dae80bacd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:31.268945 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-de24d49f-7af4-4b67-b767-215dae80bacd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:31.268945 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-de24d49f-7af4-4b67-b767-215dae80bacd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:31.412281 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-de24d49f-7af4-4b67-b767-215dae80bacd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:31.422529 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-de24d49f-7af4-4b67-b767-215dae80bacd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:31.424328 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-de24d49f-7af4-4b67-b767-215dae80bacd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:31.425717 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-de24d49f-7af4-4b67-b767-215dae80bacd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1743 microversion: 2.20 time: 0.209772 May 19 12:28:31.426337 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 492/1030] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:31 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1743 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:32.445725 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8a4116b9-28dc-4e60-89a1-d1123e9feae3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:32.446471 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8a4116b9-28dc-4e60-89a1-d1123e9feae3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:32.453108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8a4116b9-28dc-4e60-89a1-d1123e9feae3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:32.453563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8a4116b9-28dc-4e60-89a1-d1123e9feae3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:32.458566 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8a4116b9-28dc-4e60-89a1-d1123e9feae3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:32.458566 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8a4116b9-28dc-4e60-89a1-d1123e9feae3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:32.593390 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8a4116b9-28dc-4e60-89a1-d1123e9feae3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:32.601711 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8a4116b9-28dc-4e60-89a1-d1123e9feae3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:32.603773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8a4116b9-28dc-4e60-89a1-d1123e9feae3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:32.605648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8a4116b9-28dc-4e60-89a1-d1123e9feae3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1743 microversion: 2.20 time: 0.164788 May 19 12:28:32.606216 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 539/1031] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:32 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:32.632445 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9600d051-43d3-4b76-a713-c1d36c1ef8bc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:32.632983 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9600d051-43d3-4b76-a713-c1d36c1ef8bc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:32.639120 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9600d051-43d3-4b76-a713-c1d36c1ef8bc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:32.639566 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9600d051-43d3-4b76-a713-c1d36c1ef8bc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:32.640381 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9600d051-43d3-4b76-a713-c1d36c1ef8bc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:32.640814 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9600d051-43d3-4b76-a713-c1d36c1ef8bc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:32.671468 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9600d051-43d3-4b76-a713-c1d36c1ef8bc tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments/651e51f4-d93f-49cf-bc4f-c3312536e81a" status: 200 len: 194 microversion: 2.1 time: 0.043005 May 19 12:28:32.672100 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 493/1032] 10.222.0.23 () {58 vars in 1412 bytes} [Thu May 19 12:28:32 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments/651e51f4-d93f-49cf-bc4f-c3312536e81a => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:32.682336 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-dbd14521-2e8e-4b10-8004-c1995b935c35 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:32.682835 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-dbd14521-2e8e-4b10-8004-c1995b935c35 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:32.689323 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbd14521-2e8e-4b10-8004-c1995b935c35 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:32.693443 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbd14521-2e8e-4b10-8004-c1995b935c35 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:32.693443 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbd14521-2e8e-4b10-8004-c1995b935c35 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:32.693443 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbd14521-2e8e-4b10-8004-c1995b935c35 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:32.775879 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:32.780228 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-dbd14521-2e8e-4b10-8004-c1995b935c35 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lazy-loading 'services' on Instance uuid 3447311f-fa45-4fe9-bdf8-d9b88c27356f {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:28:33.165303 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-dbd14521-2e8e-4b10-8004-c1995b935c35 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments/651e51f4-d93f-49cf-bc4f-c3312536e81a" status: 202 len: 0 microversion: 2.1 time: 0.487227 May 19 12:28:33.165913 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 540/1033] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 19 12:28:32 2022] DELETE /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments/651e51f4-d93f-49cf-bc4f-c3312536e81a => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:28:33.624779 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-cd906c5b-66d5-4afd-b592-d3231d5aa034 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:33.625397 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-cd906c5b-66d5-4afd-b592-d3231d5aa034 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:33.632404 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-cd906c5b-66d5-4afd-b592-d3231d5aa034 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:33.632974 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-cd906c5b-66d5-4afd-b592-d3231d5aa034 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:33.633764 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-cd906c5b-66d5-4afd-b592-d3231d5aa034 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:33.634202 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-cd906c5b-66d5-4afd-b592-d3231d5aa034 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:33.778986 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-cd906c5b-66d5-4afd-b592-d3231d5aa034 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:33.789150 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-cd906c5b-66d5-4afd-b592-d3231d5aa034 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:33.791638 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-cd906c5b-66d5-4afd-b592-d3231d5aa034 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:33.793236 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-cd906c5b-66d5-4afd-b592-d3231d5aa034 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1743 microversion: 2.20 time: 0.173248 May 19 12:28:33.794410 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 494/1034] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:33 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:34.817723 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-46a051ec-9f47-4d6c-bc30-383f6075c977 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:34.848130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-46a051ec-9f47-4d6c-bc30-383f6075c977 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:34.848130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-46a051ec-9f47-4d6c-bc30-383f6075c977 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:34.848130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-46a051ec-9f47-4d6c-bc30-383f6075c977 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:34.848130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-46a051ec-9f47-4d6c-bc30-383f6075c977 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:34.848925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-46a051ec-9f47-4d6c-bc30-383f6075c977 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:34.995413 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-46a051ec-9f47-4d6c-bc30-383f6075c977 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:35.004824 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-46a051ec-9f47-4d6c-bc30-383f6075c977 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:35.009048 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-46a051ec-9f47-4d6c-bc30-383f6075c977 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:35.009048 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-46a051ec-9f47-4d6c-bc30-383f6075c977 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1738 microversion: 2.20 time: 0.195934 May 19 12:28:35.009048 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 541/1035] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:34 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:35.424935 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-fa7d5747-a547-42c0-99e9-a36deef9acc4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:35.426228 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-fa7d5747-a547-42c0-99e9-a36deef9acc4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:35.434989 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa7d5747-a547-42c0-99e9-a36deef9acc4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:35.435768 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa7d5747-a547-42c0-99e9-a36deef9acc4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:35.436818 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa7d5747-a547-42c0-99e9-a36deef9acc4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:35.437448 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fa7d5747-a547-42c0-99e9-a36deef9acc4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:35.474014 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-fa7d5747-a547-42c0-99e9-a36deef9acc4 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053313 May 19 12:28:35.474591 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 495/1036] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:28:35 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 12:28:35.587698 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1170c5ad-8a01-48e5-853d-54e8bf222e03 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:35.588723 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1170c5ad-8a01-48e5-853d-54e8bf222e03 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:35.595238 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1170c5ad-8a01-48e5-853d-54e8bf222e03 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:35.595685 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1170c5ad-8a01-48e5-853d-54e8bf222e03 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:35.596467 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1170c5ad-8a01-48e5-853d-54e8bf222e03 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:35.596894 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1170c5ad-8a01-48e5-853d-54e8bf222e03 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:35.626960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1170c5ad-8a01-48e5-853d-54e8bf222e03 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043093 May 19 12:28:35.627520 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 542/1037] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:28:35 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 12:28:35.687084 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ab6e6c42-0256-49ea-8598-68a88f62bac7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:35.687726 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ab6e6c42-0256-49ea-8598-68a88f62bac7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:35.694154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ab6e6c42-0256-49ea-8598-68a88f62bac7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:35.694606 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ab6e6c42-0256-49ea-8598-68a88f62bac7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:35.695397 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ab6e6c42-0256-49ea-8598-68a88f62bac7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:35.695890 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ab6e6c42-0256-49ea-8598-68a88f62bac7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:35.723237 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ab6e6c42-0256-49ea-8598-68a88f62bac7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Going to try to terminate instance {{(pid=117964) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:28:36.029782 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2bb5be8d-a303-4ad2-9fdb-47c57c586ccc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:36.031232 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2bb5be8d-a303-4ad2-9fdb-47c57c586ccc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:36.039028 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2bb5be8d-a303-4ad2-9fdb-47c57c586ccc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:36.039899 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2bb5be8d-a303-4ad2-9fdb-47c57c586ccc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:36.040966 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2bb5be8d-a303-4ad2-9fdb-47c57c586ccc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:36.041400 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2bb5be8d-a303-4ad2-9fdb-47c57c586ccc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:36.202987 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2bb5be8d-a303-4ad2-9fdb-47c57c586ccc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:36.211852 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2bb5be8d-a303-4ad2-9fdb-47c57c586ccc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:36.213597 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2bb5be8d-a303-4ad2-9fdb-47c57c586ccc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:36.215952 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2bb5be8d-a303-4ad2-9fdb-47c57c586ccc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1738 microversion: 2.20 time: 0.191544 May 19 12:28:36.216735 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 543/1038] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:36 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:36.473665 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ab6e6c42-0256-49ea-8598-68a88f62bac7 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 204 len: 0 microversion: 2.1 time: 0.791173 May 19 12:28:36.477356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 496/1039] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:28:35 2022] DELETE /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 0 bytes in 793 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:28:36.482985 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ad587039-de28-409c-8e7c-18810e5dbe8a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:36.484516 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ad587039-de28-409c-8e7c-18810e5dbe8a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:36.492436 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ad587039-de28-409c-8e7c-18810e5dbe8a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:36.493127 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ad587039-de28-409c-8e7c-18810e5dbe8a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:36.493913 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ad587039-de28-409c-8e7c-18810e5dbe8a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:36.494349 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ad587039-de28-409c-8e7c-18810e5dbe8a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:36.672229 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ad587039-de28-409c-8e7c-18810e5dbe8a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:36.681174 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ad587039-de28-409c-8e7c-18810e5dbe8a tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1673 microversion: 2.1 time: 0.201917 May 19 12:28:36.681747 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 544/1040] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:28:36 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1673 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:37.237032 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e421a652-15b9-4f0c-a6f6-7ecb1b7f78c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:37.237644 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e421a652-15b9-4f0c-a6f6-7ecb1b7f78c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:37.244361 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e421a652-15b9-4f0c-a6f6-7ecb1b7f78c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:37.244881 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e421a652-15b9-4f0c-a6f6-7ecb1b7f78c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:37.246211 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e421a652-15b9-4f0c-a6f6-7ecb1b7f78c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:37.247149 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e421a652-15b9-4f0c-a6f6-7ecb1b7f78c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:37.400541 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e421a652-15b9-4f0c-a6f6-7ecb1b7f78c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:37.421418 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e421a652-15b9-4f0c-a6f6-7ecb1b7f78c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:37.421418 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e421a652-15b9-4f0c-a6f6-7ecb1b7f78c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:37.421418 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e421a652-15b9-4f0c-a6f6-7ecb1b7f78c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1738 microversion: 2.20 time: 0.182323 May 19 12:28:37.421756 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 497/1041] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:37 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:37.700352 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-973a7416-4d22-45d0-983a-313bbd5679e3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:37.701009 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-973a7416-4d22-45d0-983a-313bbd5679e3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:37.707976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-973a7416-4d22-45d0-983a-313bbd5679e3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:37.708432 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-973a7416-4d22-45d0-983a-313bbd5679e3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:37.709211 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-973a7416-4d22-45d0-983a-313bbd5679e3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:37.709921 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-973a7416-4d22-45d0-983a-313bbd5679e3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:37.880231 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-973a7416-4d22-45d0-983a-313bbd5679e3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:37.889917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-973a7416-4d22-45d0-983a-313bbd5679e3 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1673 microversion: 2.1 time: 0.193460 May 19 12:28:37.894116 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 545/1042] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:28:37 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1673 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:38.432911 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6521616b-e7ff-4c1e-a731-11497c4707c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:38.433593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6521616b-e7ff-4c1e-a731-11497c4707c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:38.441257 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6521616b-e7ff-4c1e-a731-11497c4707c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:38.441747 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6521616b-e7ff-4c1e-a731-11497c4707c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:38.442532 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6521616b-e7ff-4c1e-a731-11497c4707c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:38.443156 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6521616b-e7ff-4c1e-a731-11497c4707c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:38.611229 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6521616b-e7ff-4c1e-a731-11497c4707c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:38.623895 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6521616b-e7ff-4c1e-a731-11497c4707c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:38.626386 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6521616b-e7ff-4c1e-a731-11497c4707c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:38.629980 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6521616b-e7ff-4c1e-a731-11497c4707c3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1738 microversion: 2.20 time: 0.198760 May 19 12:28:38.631142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 498/1043] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:38 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:38.908921 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3054f100-fd24-4fcd-b156-15859a78623e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:38.909887 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3054f100-fd24-4fcd-b156-15859a78623e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:38.915972 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3054f100-fd24-4fcd-b156-15859a78623e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:38.916424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3054f100-fd24-4fcd-b156-15859a78623e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:38.917202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3054f100-fd24-4fcd-b156-15859a78623e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:38.918521 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3054f100-fd24-4fcd-b156-15859a78623e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:39.075390 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3054f100-fd24-4fcd-b156-15859a78623e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:39.087448 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3054f100-fd24-4fcd-b156-15859a78623e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1673 microversion: 2.1 time: 0.182204 May 19 12:28:39.088098 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 546/1044] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:28:38 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1673 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:39.650858 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e118bf3a-019c-48c2-9705-15030a2c7840 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:39.651651 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e118bf3a-019c-48c2-9705-15030a2c7840 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:39.658505 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e118bf3a-019c-48c2-9705-15030a2c7840 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:39.658958 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e118bf3a-019c-48c2-9705-15030a2c7840 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:39.669203 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e118bf3a-019c-48c2-9705-15030a2c7840 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:39.669203 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e118bf3a-019c-48c2-9705-15030a2c7840 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:39.863925 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e118bf3a-019c-48c2-9705-15030a2c7840 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:39.873747 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e118bf3a-019c-48c2-9705-15030a2c7840 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:39.875389 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e118bf3a-019c-48c2-9705-15030a2c7840 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:39.876700 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e118bf3a-019c-48c2-9705-15030a2c7840 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1738 microversion: 2.20 time: 0.229901 May 19 12:28:39.877341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 499/1045] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:39 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:40.109208 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-10448d19-6e92-42e5-8cc9-c5758f2b7284 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:40.111338 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-10448d19-6e92-42e5-8cc9-c5758f2b7284 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:40.121933 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-10448d19-6e92-42e5-8cc9-c5758f2b7284 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:40.122557 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-10448d19-6e92-42e5-8cc9-c5758f2b7284 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:40.123430 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-10448d19-6e92-42e5-8cc9-c5758f2b7284 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:40.123983 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-10448d19-6e92-42e5-8cc9-c5758f2b7284 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:40.292847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-10448d19-6e92-42e5-8cc9-c5758f2b7284 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:40.301063 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-10448d19-6e92-42e5-8cc9-c5758f2b7284 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1673 microversion: 2.1 time: 0.197548 May 19 12:28:40.301662 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 547/1046] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:28:40 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1673 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:40.896225 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-79b849c8-e52d-4a46-84f9-910ae3a0b990 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:40.896858 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-79b849c8-e52d-4a46-84f9-910ae3a0b990 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:40.906063 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-79b849c8-e52d-4a46-84f9-910ae3a0b990 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:40.906603 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-79b849c8-e52d-4a46-84f9-910ae3a0b990 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:40.907572 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-79b849c8-e52d-4a46-84f9-910ae3a0b990 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:40.908150 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-79b849c8-e52d-4a46-84f9-910ae3a0b990 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:41.059958 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-96bd385f-b665-4129-8752-7d3a114ffc71 req-380ddc0a-e667-489c-a780-db6edeb3fe1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3447311f-fa45-4fe9-bdf8-d9b88c27356f", "name": "network-vif-deleted", "tag": "96b7e59a-40c2-4b31-bcdf-f5bd068dca42"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:41.080218 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-96bd385f-b665-4129-8752-7d3a114ffc71 req-380ddc0a-e667-489c-a780-db6edeb3fe1a service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:41.086957 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-96bd385f-b665-4129-8752-7d3a114ffc71 req-380ddc0a-e667-489c-a780-db6edeb3fe1a service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:41.115201 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-96bd385f-b665-4129-8752-7d3a114ffc71 req-380ddc0a-e667-489c-a780-db6edeb3fe1a service nova] Creating event network-vif-deleted:96b7e59a-40c2-4b31-bcdf-f5bd068dca42 for instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f on hv-cinder-80475 May 19 12:28:41.126958 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-96bd385f-b665-4129-8752-7d3a114ffc71 req-380ddc0a-e667-489c-a780-db6edeb3fe1a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078876 May 19 12:28:41.144647 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 548/1047] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:41.231393 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-79b849c8-e52d-4a46-84f9-910ae3a0b990 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:41.240801 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-79b849c8-e52d-4a46-84f9-910ae3a0b990 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:41.242348 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-79b849c8-e52d-4a46-84f9-910ae3a0b990 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:41.243563 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-79b849c8-e52d-4a46-84f9-910ae3a0b990 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1738 microversion: 2.20 time: 0.351846 May 19 12:28:41.244151 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 500/1048] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:40 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1738 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:41.320682 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b1364e94-123f-4cee-bbf3-da0dcba06734 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:41.321687 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b1364e94-123f-4cee-bbf3-da0dcba06734 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:41.331050 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b1364e94-123f-4cee-bbf3-da0dcba06734 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:41.331501 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b1364e94-123f-4cee-bbf3-da0dcba06734 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:41.332333 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b1364e94-123f-4cee-bbf3-da0dcba06734 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:41.332770 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b1364e94-123f-4cee-bbf3-da0dcba06734 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:41.421099 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b1364e94-123f-4cee-bbf3-da0dcba06734 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:41.429328 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b1364e94-123f-4cee-bbf3-da0dcba06734 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1606 microversion: 2.1 time: 0.113342 May 19 12:28:41.429917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 549/1049] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:28:41 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1606 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:42.275484 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9d657267-74e5-43a2-9468-133ff20aefc5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:42.275484 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9d657267-74e5-43a2-9468-133ff20aefc5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:42.275484 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9d657267-74e5-43a2-9468-133ff20aefc5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:42.275484 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9d657267-74e5-43a2-9468-133ff20aefc5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:42.277670 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9d657267-74e5-43a2-9468-133ff20aefc5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:42.278498 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9d657267-74e5-43a2-9468-133ff20aefc5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:42.451092 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a8fca4c0-abce-4f14-88e5-cf41190ead8e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:42.451851 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a8fca4c0-abce-4f14-88e5-cf41190ead8e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:42.459220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a8fca4c0-abce-4f14-88e5-cf41190ead8e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:42.460301 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a8fca4c0-abce-4f14-88e5-cf41190ead8e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:42.461487 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a8fca4c0-abce-4f14-88e5-cf41190ead8e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:42.462185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a8fca4c0-abce-4f14-88e5-cf41190ead8e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:42.474878 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9d657267-74e5-43a2-9468-133ff20aefc5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:42.494899 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9d657267-74e5-43a2-9468-133ff20aefc5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:42.500927 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a8fca4c0-abce-4f14-88e5-cf41190ead8e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:42.501391 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a8fca4c0-abce-4f14-88e5-cf41190ead8e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:42.501954 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9d657267-74e5-43a2-9468-133ff20aefc5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:42.502371 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-a8fca4c0-abce-4f14-88e5-cf41190ead8e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lazy-loading 'fault' on Instance uuid 3447311f-fa45-4fe9-bdf8-d9b88c27356f {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:28:42.504870 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9d657267-74e5-43a2-9468-133ff20aefc5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1738 microversion: 2.20 time: 0.245466 May 19 12:28:42.523300 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 501/1050] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:42 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1738 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:28:42.550733 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a8fca4c0-abce-4f14-88e5-cf41190ead8e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d762cce00ae4e468c358b0437f35deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eafee25cfb14ca2bd5c10fe41a01644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:42.573466 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a8fca4c0-abce-4f14-88e5-cf41190ead8e tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 200 len: 1327 microversion: 2.1 time: 0.118852 May 19 12:28:42.574682 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 550/1051] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:28:42 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 1327 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:43.547027 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ca36d968-0ece-4557-a98d-489c120d6a04 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:43.549342 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ca36d968-0ece-4557-a98d-489c120d6a04 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:43.562019 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ca36d968-0ece-4557-a98d-489c120d6a04 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:43.562909 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ca36d968-0ece-4557-a98d-489c120d6a04 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:43.565030 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ca36d968-0ece-4557-a98d-489c120d6a04 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:43.565907 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ca36d968-0ece-4557-a98d-489c120d6a04 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:43.609051 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0f412a86-16f7-421f-bb53-24974b856e23 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:43.611731 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0f412a86-16f7-421f-bb53-24974b856e23 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:43.624529 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0f412a86-16f7-421f-bb53-24974b856e23 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:43.625733 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0f412a86-16f7-421f-bb53-24974b856e23 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:43.627829 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0f412a86-16f7-421f-bb53-24974b856e23 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:43.629360 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0f412a86-16f7-421f-bb53-24974b856e23 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:43.658041 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-0f412a86-16f7-421f-bb53-24974b856e23 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] HTTP exception thrown: Instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f could not be found. May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0f412a86-16f7-421f-bb53-24974b856e23 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Request method failure captured: May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f HTTP/1.1 May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjWAocCXltxUECDjW2SE10qI7-nV7Bjf7s1NrL8ad3oNUeGaIx9J9ZzikV5hHDjLClr3P7QbEdIFGLlRqcV7qqQDqiCjmEs4gnp7l4yIuAmzJVyZhzmeB0BoNiZKYrD6lEYM_ge-lVZu-3JWtMIgYVHyxbTDGLHsXUrb2zegdk0JWyQ May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 9eafee25cfb14ca2bd5c10fe41a01644 May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeTestJSON-1559525414 May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:28:43.663584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:28:43.666224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:28:43.666224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeTestJSON-1559525414 May 19 12:28:43.666224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 9eafee25cfb14ca2bd5c10fe41a01644 May 19 12:28:43.666224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1559525414 May 19 12:28:43.666224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeTestJSON-1559525414-project May 19 12:28:43.666224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:28:43.666224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:28:43.666224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: 9d762cce00ae4e468c358b0437f35deb May 19 12:28:43.666224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeTestJSON-1559525414-project May 19 12:28:43.666224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:28:43.666224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f could not be found. May 19 12:28:43.666224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': '3447311f-fa45-4fe9-bdf8-d9b88c27356f'} May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f could not be found. May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:28:43.668137 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:28:43.671641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:28:43.671641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:28:43.671641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:28:43.671641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:28:43.671641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:28:43.671641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:28:43.671641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:28:43.671641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f could not be found. May 19 12:28:43.671641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:28:43.671641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:28:43.671641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:28:43.671641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:28:43.671641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:28:43.671641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:28:43.671641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:28:43.671641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:28:43.671641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f could not be found. May 19 12:28:43.671641 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:28:43.676143 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0f412a86-16f7-421f-bb53-24974b856e23 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Returning 404 to user: Instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:28:43.677756 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0f412a86-16f7-421f-bb53-24974b856e23 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 404 len: 111 microversion: 2.1 time: 0.077391 May 19 12:28:43.685197 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 551/1052] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:28:43 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:28:43.694514 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-805718e5-d822-45ad-8395-08d5771acbda tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '.version_select at 0x7f3b9da11670>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:43.807403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ca36d968-0ece-4557-a98d-489c120d6a04 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:43.825374 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-805718e5-d822-45ad-8395-08d5771acbda tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-884044206" status: 202 len: 0 microversion: 2.1 time: 0.138011 May 19 12:28:43.829861 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 552/1053] 10.222.0.23 () {58 vars in 1217 bytes} [Thu May 19 12:28:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-884044206 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:28:43.830080 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ca36d968-0ece-4557-a98d-489c120d6a04 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:43.845120 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ca36d968-0ece-4557-a98d-489c120d6a04 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:43.847945 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ca36d968-0ece-4557-a98d-489c120d6a04 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1738 microversion: 2.20 time: 0.309812 May 19 12:28:43.861472 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 502/1054] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:43 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1738 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:44.869740 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-54442a19-f8bd-4c88-a218-6a09669f2632 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:44.871474 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-54442a19-f8bd-4c88-a218-6a09669f2632 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:44.885652 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-54442a19-f8bd-4c88-a218-6a09669f2632 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:44.887450 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-54442a19-f8bd-4c88-a218-6a09669f2632 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:44.889542 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-54442a19-f8bd-4c88-a218-6a09669f2632 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:44.890310 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-54442a19-f8bd-4c88-a218-6a09669f2632 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:45.140469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-54442a19-f8bd-4c88-a218-6a09669f2632 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:45.155217 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-54442a19-f8bd-4c88-a218-6a09669f2632 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:45.158196 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-54442a19-f8bd-4c88-a218-6a09669f2632 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:45.159950 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-54442a19-f8bd-4c88-a218-6a09669f2632 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1738 microversion: 2.20 time: 0.295074 May 19 12:28:45.161149 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 553/1055] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:44 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1738 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:28:46.235850 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a0c12bf0-0cfd-443c-9e46-230031f53fc7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:46.235850 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a0c12bf0-0cfd-443c-9e46-230031f53fc7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:46.235850 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a0c12bf0-0cfd-443c-9e46-230031f53fc7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:46.235850 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a0c12bf0-0cfd-443c-9e46-230031f53fc7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:46.236768 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a0c12bf0-0cfd-443c-9e46-230031f53fc7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:46.236768 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a0c12bf0-0cfd-443c-9e46-230031f53fc7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:46.408243 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a0c12bf0-0cfd-443c-9e46-230031f53fc7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:46.417441 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a0c12bf0-0cfd-443c-9e46-230031f53fc7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:46.419577 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a0c12bf0-0cfd-443c-9e46-230031f53fc7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:46.421222 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a0c12bf0-0cfd-443c-9e46-230031f53fc7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1738 microversion: 2.20 time: 0.214757 May 19 12:28:46.421831 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 503/1056] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:46 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:47.451169 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-044d9f44-36d3-4ab2-bdf7-5190ef8ddeb4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:47.452615 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-044d9f44-36d3-4ab2-bdf7-5190ef8ddeb4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:47.478113 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-044d9f44-36d3-4ab2-bdf7-5190ef8ddeb4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:47.481457 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-044d9f44-36d3-4ab2-bdf7-5190ef8ddeb4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:47.482725 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-044d9f44-36d3-4ab2-bdf7-5190ef8ddeb4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:47.483479 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-044d9f44-36d3-4ab2-bdf7-5190ef8ddeb4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:47.738967 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-044d9f44-36d3-4ab2-bdf7-5190ef8ddeb4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:47.767039 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-044d9f44-36d3-4ab2-bdf7-5190ef8ddeb4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:47.771531 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-044d9f44-36d3-4ab2-bdf7-5190ef8ddeb4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:47.773709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-044d9f44-36d3-4ab2-bdf7-5190ef8ddeb4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1738 microversion: 2.20 time: 0.329942 May 19 12:28:47.775166 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 554/1057] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:47 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1738 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:48.795175 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-3583c3bb-88b1-4111-adf5-34617651ec03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:48.795898 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-3583c3bb-88b1-4111-adf5-34617651ec03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:48.803007 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3583c3bb-88b1-4111-adf5-34617651ec03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:48.803615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3583c3bb-88b1-4111-adf5-34617651ec03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:48.804566 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3583c3bb-88b1-4111-adf5-34617651ec03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:48.805262 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3583c3bb-88b1-4111-adf5-34617651ec03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:48.984735 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-3583c3bb-88b1-4111-adf5-34617651ec03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:48.987421 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:49.000838 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-3583c3bb-88b1-4111-adf5-34617651ec03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:49.002583 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-3583c3bb-88b1-4111-adf5-34617651ec03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:49.004095 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-3583c3bb-88b1-4111-adf5-34617651ec03 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1738 microversion: 2.20 time: 0.213685 May 19 12:28:49.004665 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 504/1058] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:48 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:28:49.724306 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-321959ff-aec8-4f0d-960b-dcaacabdc789 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:49.725432 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-321959ff-aec8-4f0d-960b-dcaacabdc789 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:49.735903 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-321959ff-aec8-4f0d-960b-dcaacabdc789 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:49.738066 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-321959ff-aec8-4f0d-960b-dcaacabdc789 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:49.752392 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-321959ff-aec8-4f0d-960b-dcaacabdc789 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:49.753097 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-321959ff-aec8-4f0d-960b-dcaacabdc789 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:49.769475 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-321959ff-aec8-4f0d-960b-dcaacabdc789 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] HTTP exception thrown: Instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f could not be found. May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-321959ff-aec8-4f0d-960b-dcaacabdc789 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Request method failure captured: May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: DELETE /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f HTTP/1.1 May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjWAocCXltxUECDjW2SE10qI7-nV7Bjf7s1NrL8ad3oNUeGaIx9J9ZzikV5hHDjLClr3P7QbEdIFGLlRqcV7qqQDqiCjmEs4gnp7l4yIuAmzJVyZhzmeB0BoNiZKYrD6lEYM_ge-lVZu-3JWtMIgYVHyxbTDGLHsXUrb2zegdk0JWyQ May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 9eafee25cfb14ca2bd5c10fe41a01644 May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeTestJSON-1559525414 May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:28:49.771970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:28:49.773580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:28:49.773580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeTestJSON-1559525414 May 19 12:28:49.773580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 9eafee25cfb14ca2bd5c10fe41a01644 May 19 12:28:49.773580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1559525414 May 19 12:28:49.773580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeTestJSON-1559525414-project May 19 12:28:49.773580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:28:49.773580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:28:49.773580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: 9d762cce00ae4e468c358b0437f35deb May 19 12:28:49.773580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeTestJSON-1559525414-project May 19 12:28:49.773580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:28:49.773580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f could not be found. May 19 12:28:49.773580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': '3447311f-fa45-4fe9-bdf8-d9b88c27356f'} May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f could not be found. May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:28:49.774428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f could not be found. May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f could not be found. May 19 12:28:49.775930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:28:49.778902 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-321959ff-aec8-4f0d-960b-dcaacabdc789 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Returning 404 to user: Instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:28:49.780074 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-321959ff-aec8-4f0d-960b-dcaacabdc789 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 404 len: 111 microversion: 2.1 time: 0.060036 May 19 12:28:49.781147 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 555/1059] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:28:49 2022] DELETE /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:28:49.797636 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-36fd568a-89e5-4737-9aa9-3584ce697393 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:49.798959 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-36fd568a-89e5-4737-9aa9-3584ce697393 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 3447311f-fa45-4fe9-bdf8-d9b88c27356f] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:49.815944 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-36fd568a-89e5-4737-9aa9-3584ce697393 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:49.816784 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-36fd568a-89e5-4737-9aa9-3584ce697393 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:49.818302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-36fd568a-89e5-4737-9aa9-3584ce697393 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:49.819131 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-36fd568a-89e5-4737-9aa9-3584ce697393 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:49.842261 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-36fd568a-89e5-4737-9aa9-3584ce697393 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] HTTP exception thrown: Instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f could not be found. May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-36fd568a-89e5-4737-9aa9-3584ce697393 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Request method failure captured: May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f HTTP/1.1 May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjWAocCXltxUECDjW2SE10qI7-nV7Bjf7s1NrL8ad3oNUeGaIx9J9ZzikV5hHDjLClr3P7QbEdIFGLlRqcV7qqQDqiCjmEs4gnp7l4yIuAmzJVyZhzmeB0BoNiZKYrD6lEYM_ge-lVZu-3JWtMIgYVHyxbTDGLHsXUrb2zegdk0JWyQ May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 9eafee25cfb14ca2bd5c10fe41a01644 May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-AttachVolumeTestJSON-1559525414 May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:28:49.844132 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:28:49.845682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:28:49.845682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-AttachVolumeTestJSON-1559525414 May 19 12:28:49.845682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 9eafee25cfb14ca2bd5c10fe41a01644 May 19 12:28:49.845682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1559525414 May 19 12:28:49.845682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-AttachVolumeTestJSON-1559525414-project May 19 12:28:49.845682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:28:49.845682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:28:49.845682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: 9d762cce00ae4e468c358b0437f35deb May 19 12:28:49.845682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-AttachVolumeTestJSON-1559525414-project May 19 12:28:49.845682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:28:49.845682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f could not be found. May 19 12:28:49.845682 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': '3447311f-fa45-4fe9-bdf8-d9b88c27356f'} May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f could not be found. May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:28:49.849679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:28:49.851221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:28:49.851221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:28:49.851221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:28:49.851221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:28:49.851221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:28:49.851221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:28:49.851221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:28:49.851221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f could not be found. May 19 12:28:49.851221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:28:49.851221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:28:49.851221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:28:49.851221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:28:49.851221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:28:49.851221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:28:49.851221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:28:49.851221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:28:49.851221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f could not be found. May 19 12:28:49.851221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:28:49.852606 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-36fd568a-89e5-4737-9aa9-3584ce697393 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Returning 404 to user: Instance 3447311f-fa45-4fe9-bdf8-d9b88c27356f could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:28:49.852606 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-36fd568a-89e5-4737-9aa9-3584ce697393 tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f" status: 404 len: 111 microversion: 2.1 time: 0.058592 May 19 12:28:49.852606 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 505/1060] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:28:49 2022] GET /compute/v2.1/servers/3447311f-fa45-4fe9-bdf8-d9b88c27356f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:28:50.036189 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5f6ee3ef-7c54-4b5f-8953-c66a371e709d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:50.037203 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5f6ee3ef-7c54-4b5f-8953-c66a371e709d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:50.050128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5f6ee3ef-7c54-4b5f-8953-c66a371e709d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:50.053276 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5f6ee3ef-7c54-4b5f-8953-c66a371e709d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:50.053276 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5f6ee3ef-7c54-4b5f-8953-c66a371e709d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:50.053276 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5f6ee3ef-7c54-4b5f-8953-c66a371e709d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:50.334842 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5f6ee3ef-7c54-4b5f-8953-c66a371e709d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:50.345778 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5f6ee3ef-7c54-4b5f-8953-c66a371e709d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:50.347288 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5f6ee3ef-7c54-4b5f-8953-c66a371e709d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:50.348977 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5f6ee3ef-7c54-4b5f-8953-c66a371e709d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1738 microversion: 2.20 time: 0.323218 May 19 12:28:50.350022 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 556/1061] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:50 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1738 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:51.386903 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-11845ab4-6c36-418b-af59-174bc1c3281c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:51.387984 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-11845ab4-6c36-418b-af59-174bc1c3281c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:51.400551 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-11845ab4-6c36-418b-af59-174bc1c3281c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:51.401364 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-11845ab4-6c36-418b-af59-174bc1c3281c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:51.403488 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-11845ab4-6c36-418b-af59-174bc1c3281c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:51.404297 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-11845ab4-6c36-418b-af59-174bc1c3281c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:51.567421 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-11845ab4-6c36-418b-af59-174bc1c3281c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:51.582796 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-11845ab4-6c36-418b-af59-174bc1c3281c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:51.585763 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-11845ab4-6c36-418b-af59-174bc1c3281c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:51.587756 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-11845ab4-6c36-418b-af59-174bc1c3281c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1738 microversion: 2.20 time: 0.209549 May 19 12:28:51.588581 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 506/1062] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:51 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:51.598287 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c6269b97-9107-4ace-b1e4-31d7b1319f9f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:51.600436 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c6269b97-9107-4ace-b1e4-31d7b1319f9f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:51.606814 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c6269b97-9107-4ace-b1e4-31d7b1319f9f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:51.607269 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c6269b97-9107-4ace-b1e4-31d7b1319f9f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:51.608125 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c6269b97-9107-4ace-b1e4-31d7b1319f9f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:51.608573 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c6269b97-9107-4ace-b1e4-31d7b1319f9f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:51.625357 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-c6269b97-9107-4ace-b1e4-31d7b1319f9f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] HTTP exception thrown: Instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 could not be found. May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c6269b97-9107-4ace-b1e4-31d7b1319f9f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Request method failure captured: May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: DELETE /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 HTTP/1.1 May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjWAocCXltxUECDjW2SE10qI7-nV7Bjf7s1NrL8ad3oNUeGaIx9J9ZzikV5hHDjLClr3P7QbEdIFGLlRqcV7qqQDqiCjmEs4gnp7l4yIuAmzJVyZhzmeB0BoNiZKYrD6lEYM_ge-lVZu-3JWtMIgYVHyxbTDGLHsXUrb2zegdk0JWyQ May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 9eafee25cfb14ca2bd5c10fe41a01644 May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeTestJSON-1559525414 May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:28:51.626979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:28:51.629424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:28:51.629424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeTestJSON-1559525414 May 19 12:28:51.629424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 9eafee25cfb14ca2bd5c10fe41a01644 May 19 12:28:51.629424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1559525414 May 19 12:28:51.629424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeTestJSON-1559525414-project May 19 12:28:51.629424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:28:51.629424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:28:51.629424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: 9d762cce00ae4e468c358b0437f35deb May 19 12:28:51.629424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeTestJSON-1559525414-project May 19 12:28:51.629424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:28:51.629424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 could not be found. May 19 12:28:51.629424 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': '68e76015-a6d8-4580-a1ab-4a11f42cb6f0'} May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 could not be found. May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:28:51.630917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 could not be found. May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 could not be found. May 19 12:28:51.633511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:28:51.636726 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c6269b97-9107-4ace-b1e4-31d7b1319f9f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Returning 404 to user: Instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:28:51.636726 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c6269b97-9107-4ace-b1e4-31d7b1319f9f tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 404 len: 111 microversion: 2.1 time: 0.035049 May 19 12:28:51.636726 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 557/1063] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:28:51 2022] DELETE /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:28:51.640808 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0faab727-ed60-43af-9a0a-4ff99de3d56c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:51.641846 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0faab727-ed60-43af-9a0a-4ff99de3d56c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] [instance: 68e76015-a6d8-4580-a1ab-4a11f42cb6f0] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:51.650104 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0faab727-ed60-43af-9a0a-4ff99de3d56c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:51.650769 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0faab727-ed60-43af-9a0a-4ff99de3d56c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:51.651689 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0faab727-ed60-43af-9a0a-4ff99de3d56c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:51.652812 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0faab727-ed60-43af-9a0a-4ff99de3d56c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:51.671078 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-0faab727-ed60-43af-9a0a-4ff99de3d56c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] HTTP exception thrown: Instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 could not be found. May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0faab727-ed60-43af-9a0a-4ff99de3d56c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Request method failure captured: May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 HTTP/1.1 May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjWAocCXltxUECDjW2SE10qI7-nV7Bjf7s1NrL8ad3oNUeGaIx9J9ZzikV5hHDjLClr3P7QbEdIFGLlRqcV7qqQDqiCjmEs4gnp7l4yIuAmzJVyZhzmeB0BoNiZKYrD6lEYM_ge-lVZu-3JWtMIgYVHyxbTDGLHsXUrb2zegdk0JWyQ May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 9eafee25cfb14ca2bd5c10fe41a01644 May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-AttachVolumeTestJSON-1559525414 May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:28:51.673174 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:28:51.675133 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9eafee25cfb14ca2bd5c10fe41a01644"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:28:51.675133 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-AttachVolumeTestJSON-1559525414 May 19 12:28:51.675133 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 9eafee25cfb14ca2bd5c10fe41a01644 May 19 12:28:51.675133 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1559525414 May 19 12:28:51.675133 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-AttachVolumeTestJSON-1559525414-project May 19 12:28:51.675133 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:28:51.675133 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:28:51.675133 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: 9d762cce00ae4e468c358b0437f35deb May 19 12:28:51.675133 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-AttachVolumeTestJSON-1559525414-project May 19 12:28:51.675133 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:28:51.675133 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 could not be found. May 19 12:28:51.675133 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': '68e76015-a6d8-4580-a1ab-4a11f42cb6f0'} May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 could not be found. May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:28:51.676283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:28:51.678189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:28:51.678189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:28:51.678189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:28:51.678189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:28:51.678189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:28:51.678189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:28:51.678189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:28:51.678189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 could not be found. May 19 12:28:51.678189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:28:51.678189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:28:51.678189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:28:51.678189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:28:51.678189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:28:51.678189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:28:51.678189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:28:51.678189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:28:51.678189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 could not be found. May 19 12:28:51.678189 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:28:51.679754 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0faab727-ed60-43af-9a0a-4ff99de3d56c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] Returning 404 to user: Instance 68e76015-a6d8-4580-a1ab-4a11f42cb6f0 could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:28:51.679754 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0faab727-ed60-43af-9a0a-4ff99de3d56c tempest-AttachVolumeTestJSON-1559525414 tempest-AttachVolumeTestJSON-1559525414-project] 10.222.0.23 "GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0" status: 404 len: 111 microversion: 2.1 time: 0.039954 May 19 12:28:51.679754 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 507/1064] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:28:51 2022] GET /compute/v2.1/servers/68e76015-a6d8-4580-a1ab-4a11f42cb6f0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:28:52.610951 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-69abaf8f-a386-46b1-a948-b519a2340ef6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:52.611613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-69abaf8f-a386-46b1-a948-b519a2340ef6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:52.619235 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-69abaf8f-a386-46b1-a948-b519a2340ef6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:52.619691 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-69abaf8f-a386-46b1-a948-b519a2340ef6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:52.620867 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-69abaf8f-a386-46b1-a948-b519a2340ef6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:52.620867 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-69abaf8f-a386-46b1-a948-b519a2340ef6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:52.789093 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-69abaf8f-a386-46b1-a948-b519a2340ef6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:52.799437 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-69abaf8f-a386-46b1-a948-b519a2340ef6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:52.801009 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-69abaf8f-a386-46b1-a948-b519a2340ef6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:52.802224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-69abaf8f-a386-46b1-a948-b519a2340ef6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1738 microversion: 2.20 time: 0.196331 May 19 12:28:52.803037 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 558/1065] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:52 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:53.828868 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ed73e930-0f9d-48de-9084-8f39447593d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:53.830049 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ed73e930-0f9d-48de-9084-8f39447593d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:53.843996 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ed73e930-0f9d-48de-9084-8f39447593d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:53.844785 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ed73e930-0f9d-48de-9084-8f39447593d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:53.846216 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ed73e930-0f9d-48de-9084-8f39447593d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:53.846986 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ed73e930-0f9d-48de-9084-8f39447593d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:54.179844 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ed73e930-0f9d-48de-9084-8f39447593d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:54.197408 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ed73e930-0f9d-48de-9084-8f39447593d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:54.201215 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ed73e930-0f9d-48de-9084-8f39447593d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:54.203977 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ed73e930-0f9d-48de-9084-8f39447593d1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1720 microversion: 2.20 time: 0.384102 May 19 12:28:54.223426 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 508/1066] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:53 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1720 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:55.234825 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6946ecd7-02b7-4749-a343-27c3eabf5aa3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:55.236189 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6946ecd7-02b7-4749-a343-27c3eabf5aa3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:55.246245 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6946ecd7-02b7-4749-a343-27c3eabf5aa3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:55.246695 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6946ecd7-02b7-4749-a343-27c3eabf5aa3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:55.248194 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6946ecd7-02b7-4749-a343-27c3eabf5aa3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:55.248818 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6946ecd7-02b7-4749-a343-27c3eabf5aa3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:55.419249 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6946ecd7-02b7-4749-a343-27c3eabf5aa3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:55.429741 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6946ecd7-02b7-4749-a343-27c3eabf5aa3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:55.432250 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6946ecd7-02b7-4749-a343-27c3eabf5aa3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:55.435000 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6946ecd7-02b7-4749-a343-27c3eabf5aa3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1720 microversion: 2.20 time: 0.207412 May 19 12:28:55.446895 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 559/1067] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:55 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:28:56.455845 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0be94c99-aafc-466b-b073-6faca41aa4a0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:56.456614 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0be94c99-aafc-466b-b073-6faca41aa4a0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:56.463287 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0be94c99-aafc-466b-b073-6faca41aa4a0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:56.464218 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0be94c99-aafc-466b-b073-6faca41aa4a0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:56.465241 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0be94c99-aafc-466b-b073-6faca41aa4a0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:56.465561 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0be94c99-aafc-466b-b073-6faca41aa4a0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:56.725796 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-0be94c99-aafc-466b-b073-6faca41aa4a0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:56.743581 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-0be94c99-aafc-466b-b073-6faca41aa4a0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:56.745264 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-0be94c99-aafc-466b-b073-6faca41aa4a0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:56.746688 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0be94c99-aafc-466b-b073-6faca41aa4a0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1720 microversion: 2.20 time: 0.295517 May 19 12:28:56.747252 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 509/1068] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:56 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1720 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:57.358660 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-8af1f62a-b939-466a-92dc-79963c7db77d req-df200822-7ac3-4429-ad6d-7ee5cb8a14d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315fa402-5c50-4d9d-bfba-b2e39a9133ec", "name": "network-vif-unplugged", "status": "completed", "tag": "60a88c1e-75f6-4fbf-9da2-da492fbaa3ed"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:57.375917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-8af1f62a-b939-466a-92dc-79963c7db77d req-df200822-7ac3-4429-ad6d-7ee5cb8a14d0 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:57.376710 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-8af1f62a-b939-466a-92dc-79963c7db77d req-df200822-7ac3-4429-ad6d-7ee5cb8a14d0 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:57.388886 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:57.405757 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-8af1f62a-b939-466a-92dc-79963c7db77d req-df200822-7ac3-4429-ad6d-7ee5cb8a14d0 service nova] Creating event network-vif-unplugged:60a88c1e-75f6-4fbf-9da2-da492fbaa3ed for instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec on hv-cinder-80475 May 19 12:28:57.415258 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-8af1f62a-b939-466a-92dc-79963c7db77d req-df200822-7ac3-4429-ad6d-7ee5cb8a14d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064211 May 19 12:28:57.416344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 560/1069] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:57.766579 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ae467ebb-dd10-4b22-9694-9354e61bf32f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:57.767192 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ae467ebb-dd10-4b22-9694-9354e61bf32f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:57.774767 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ae467ebb-dd10-4b22-9694-9354e61bf32f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:57.775213 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ae467ebb-dd10-4b22-9694-9354e61bf32f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:57.776062 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ae467ebb-dd10-4b22-9694-9354e61bf32f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:57.776516 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ae467ebb-dd10-4b22-9694-9354e61bf32f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:57.963107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ae467ebb-dd10-4b22-9694-9354e61bf32f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:57.970296 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ae467ebb-dd10-4b22-9694-9354e61bf32f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:57.971984 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ae467ebb-dd10-4b22-9694-9354e61bf32f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:57.973410 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ae467ebb-dd10-4b22-9694-9354e61bf32f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1663 microversion: 2.20 time: 0.211437 May 19 12:28:57.973996 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 510/1070] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:28:57 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1663 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:57.998628 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e447df89-aa15-44ef-a63a-1bd6d70ef8fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c2765fa-a7a7-4e65-8330-93ed1c85cb9b"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:58.000458 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e447df89-aa15-44ef-a63a-1bd6d70ef8fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:58.013836 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e447df89-aa15-44ef-a63a-1bd6d70ef8fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:58.014658 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e447df89-aa15-44ef-a63a-1bd6d70ef8fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:58.016045 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e447df89-aa15-44ef-a63a-1bd6d70ef8fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:58.016840 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e447df89-aa15-44ef-a63a-1bd6d70ef8fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:00.049394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e447df89-aa15-44ef-a63a-1bd6d70ef8fd tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "POST /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.054633 May 19 12:29:00.049394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 561/1071] 10.222.0.23 () {62 vars in 1363 bytes} [Thu May 19 12:28:57 2022] POST /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec/os-volume_attachments => generated 188 bytes in 2057 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:29:00.191477 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f654d4d4-66e6-403a-ad2f-bc6e043ba2a1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:00.192115 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f654d4d4-66e6-403a-ad2f-bc6e043ba2a1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:00.194639 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:00.200847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f654d4d4-66e6-403a-ad2f-bc6e043ba2a1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:00.201298 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f654d4d4-66e6-403a-ad2f-bc6e043ba2a1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:00.202171 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f654d4d4-66e6-403a-ad2f-bc6e043ba2a1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:00.202618 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f654d4d4-66e6-403a-ad2f-bc6e043ba2a1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:01.256585 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f654d4d4-66e6-403a-ad2f-bc6e043ba2a1 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "DELETE /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec/os-volume_attachments/4c2765fa-a7a7-4e65-8330-93ed1c85cb9b" status: 202 len: 0 microversion: 2.20 time: 1.069073 May 19 12:29:01.258014 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 511/1072] 10.222.0.23 () {60 vars in 1456 bytes} [Thu May 19 12:29:00 2022] DELETE /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec/os-volume_attachments/4c2765fa-a7a7-4e65-8330-93ed1c85cb9b => generated 0 bytes in 1071 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 12:29:01.343261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-76597c63-942a-4a71-b4b6-5601c14c3b00 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:29:01.344716 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-76597c63-942a-4a71-b4b6-5601c14c3b00 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:01.348361 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:01.356679 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-76597c63-942a-4a71-b4b6-5601c14c3b00 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:01.361592 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-76597c63-942a-4a71-b4b6-5601c14c3b00 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:01.361592 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-76597c63-942a-4a71-b4b6-5601c14c3b00 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:01.361592 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-76597c63-942a-4a71-b4b6-5601c14c3b00 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:01.657004 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-76597c63-942a-4a71-b4b6-5601c14c3b00 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "POST /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec/action" status: 202 len: 0 microversion: 2.20 time: 0.320734 May 19 12:29:01.658394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 562/1073] 10.222.0.23 () {62 vars in 1318 bytes} [Thu May 19 12:29:01 2022] POST /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 19 12:29:01.672324 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-312b3a1a-8d24-48c5-9b89-8ef69df7f33c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:01.672324 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-312b3a1a-8d24-48c5-9b89-8ef69df7f33c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:01.685583 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-312b3a1a-8d24-48c5-9b89-8ef69df7f33c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:01.685583 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-312b3a1a-8d24-48c5-9b89-8ef69df7f33c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:01.686877 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-312b3a1a-8d24-48c5-9b89-8ef69df7f33c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:01.687595 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-312b3a1a-8d24-48c5-9b89-8ef69df7f33c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:01.912024 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-312b3a1a-8d24-48c5-9b89-8ef69df7f33c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:01.926726 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-312b3a1a-8d24-48c5-9b89-8ef69df7f33c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:01.941739 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-312b3a1a-8d24-48c5-9b89-8ef69df7f33c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:01.941739 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-312b3a1a-8d24-48c5-9b89-8ef69df7f33c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1671 microversion: 2.20 time: 0.273266 May 19 12:29:01.941739 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 512/1074] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:01 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1671 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:02.964356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-676fbbfa-3058-4477-aaaf-10b60001b65e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:02.965568 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-676fbbfa-3058-4477-aaaf-10b60001b65e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:02.977156 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-676fbbfa-3058-4477-aaaf-10b60001b65e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:02.978025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-676fbbfa-3058-4477-aaaf-10b60001b65e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:02.979630 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-676fbbfa-3058-4477-aaaf-10b60001b65e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:02.980444 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-676fbbfa-3058-4477-aaaf-10b60001b65e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:03.162685 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-676fbbfa-3058-4477-aaaf-10b60001b65e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:03.174285 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-676fbbfa-3058-4477-aaaf-10b60001b65e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:03.174285 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-676fbbfa-3058-4477-aaaf-10b60001b65e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:03.175359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-676fbbfa-3058-4477-aaaf-10b60001b65e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1671 microversion: 2.20 time: 0.219732 May 19 12:29:03.175918 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 563/1075] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:02 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1671 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:29:04.194989 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-99f84e25-752e-488b-800b-e5d369d81f7e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:04.195957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-99f84e25-752e-488b-800b-e5d369d81f7e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:04.203308 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-99f84e25-752e-488b-800b-e5d369d81f7e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:04.203756 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-99f84e25-752e-488b-800b-e5d369d81f7e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:04.204593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-99f84e25-752e-488b-800b-e5d369d81f7e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:04.205029 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-99f84e25-752e-488b-800b-e5d369d81f7e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:04.393098 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-99f84e25-752e-488b-800b-e5d369d81f7e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:04.403690 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-99f84e25-752e-488b-800b-e5d369d81f7e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:04.405852 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-99f84e25-752e-488b-800b-e5d369d81f7e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:04.407155 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-99f84e25-752e-488b-800b-e5d369d81f7e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1671 microversion: 2.20 time: 0.216362 May 19 12:29:04.407723 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 513/1076] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:04 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1671 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:05.430441 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a278157a-fd93-4f19-8986-c0945961a3a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:05.431489 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a278157a-fd93-4f19-8986-c0945961a3a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:05.444315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a278157a-fd93-4f19-8986-c0945961a3a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:05.445113 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a278157a-fd93-4f19-8986-c0945961a3a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:05.446549 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a278157a-fd93-4f19-8986-c0945961a3a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:05.447342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a278157a-fd93-4f19-8986-c0945961a3a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:05.657189 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a278157a-fd93-4f19-8986-c0945961a3a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:05.673548 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a278157a-fd93-4f19-8986-c0945961a3a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:05.676732 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a278157a-fd93-4f19-8986-c0945961a3a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:05.678950 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a278157a-fd93-4f19-8986-c0945961a3a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.255508 May 19 12:29:05.680112 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 564/1077] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:05 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:06.704679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-8b9c80e8-50b6-4fe9-8e12-0b44212e7ff0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:06.706643 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-8b9c80e8-50b6-4fe9-8e12-0b44212e7ff0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:06.718780 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8b9c80e8-50b6-4fe9-8e12-0b44212e7ff0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:06.719991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8b9c80e8-50b6-4fe9-8e12-0b44212e7ff0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:06.721782 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8b9c80e8-50b6-4fe9-8e12-0b44212e7ff0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:06.723102 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8b9c80e8-50b6-4fe9-8e12-0b44212e7ff0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:06.913977 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-8b9c80e8-50b6-4fe9-8e12-0b44212e7ff0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:06.930456 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-8b9c80e8-50b6-4fe9-8e12-0b44212e7ff0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:06.934359 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-8b9c80e8-50b6-4fe9-8e12-0b44212e7ff0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:06.937202 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-8b9c80e8-50b6-4fe9-8e12-0b44212e7ff0 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.240754 May 19 12:29:06.954620 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 514/1078] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:06 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:07.972477 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b3fec39f-c079-4fb5-a456-1a5cf8f2d64b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:07.974013 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b3fec39f-c079-4fb5-a456-1a5cf8f2d64b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:07.989982 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b3fec39f-c079-4fb5-a456-1a5cf8f2d64b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:07.991315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b3fec39f-c079-4fb5-a456-1a5cf8f2d64b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:07.992869 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b3fec39f-c079-4fb5-a456-1a5cf8f2d64b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:07.993630 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b3fec39f-c079-4fb5-a456-1a5cf8f2d64b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:08.193067 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b3fec39f-c079-4fb5-a456-1a5cf8f2d64b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:08.211001 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b3fec39f-c079-4fb5-a456-1a5cf8f2d64b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:08.219186 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b3fec39f-c079-4fb5-a456-1a5cf8f2d64b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:08.222468 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b3fec39f-c079-4fb5-a456-1a5cf8f2d64b tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.257875 May 19 12:29:08.224879 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 565/1079] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:07 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:09.258162 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b4115501-d459-474c-8f4d-7391b551361e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:09.259558 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-b4115501-d459-474c-8f4d-7391b551361e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:09.267908 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b4115501-d459-474c-8f4d-7391b551361e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:09.268370 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b4115501-d459-474c-8f4d-7391b551361e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:09.269159 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b4115501-d459-474c-8f4d-7391b551361e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:09.269598 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b4115501-d459-474c-8f4d-7391b551361e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:09.442624 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b4115501-d459-474c-8f4d-7391b551361e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:09.453001 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b4115501-d459-474c-8f4d-7391b551361e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:09.454616 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-b4115501-d459-474c-8f4d-7391b551361e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:09.455875 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b4115501-d459-474c-8f4d-7391b551361e tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.207562 May 19 12:29:09.456459 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 515/1080] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:09 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:10.480263 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-100b951e-51c1-4c2a-952d-ca9370081b17 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:10.480989 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-100b951e-51c1-4c2a-952d-ca9370081b17 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:10.488623 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-100b951e-51c1-4c2a-952d-ca9370081b17 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:10.489109 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-100b951e-51c1-4c2a-952d-ca9370081b17 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:10.489932 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-100b951e-51c1-4c2a-952d-ca9370081b17 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:10.490368 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-100b951e-51c1-4c2a-952d-ca9370081b17 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:10.635297 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-100b951e-51c1-4c2a-952d-ca9370081b17 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:10.644426 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-100b951e-51c1-4c2a-952d-ca9370081b17 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:10.645972 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-100b951e-51c1-4c2a-952d-ca9370081b17 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:10.647223 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-100b951e-51c1-4c2a-952d-ca9370081b17 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.172091 May 19 12:29:10.647809 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 566/1081] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:10 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:11.670971 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6f21a7aa-9093-4ffa-bfa2-d4ece20433cc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:11.672035 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6f21a7aa-9093-4ffa-bfa2-d4ece20433cc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:11.679501 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6f21a7aa-9093-4ffa-bfa2-d4ece20433cc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:11.680041 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6f21a7aa-9093-4ffa-bfa2-d4ece20433cc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:11.681070 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6f21a7aa-9093-4ffa-bfa2-d4ece20433cc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:11.681545 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6f21a7aa-9093-4ffa-bfa2-d4ece20433cc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:11.875124 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6f21a7aa-9093-4ffa-bfa2-d4ece20433cc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:11.884336 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6f21a7aa-9093-4ffa-bfa2-d4ece20433cc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:11.886129 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6f21a7aa-9093-4ffa-bfa2-d4ece20433cc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:11.887894 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6f21a7aa-9093-4ffa-bfa2-d4ece20433cc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.222407 May 19 12:29:11.888479 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 516/1082] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:11 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:29:12.914774 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-419b8d59-546c-4b45-98c9-d19cbed92b7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:12.915326 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-419b8d59-546c-4b45-98c9-d19cbed92b7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:12.922428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-419b8d59-546c-4b45-98c9-d19cbed92b7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:12.922870 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-419b8d59-546c-4b45-98c9-d19cbed92b7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:12.923639 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-419b8d59-546c-4b45-98c9-d19cbed92b7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:12.924093 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-419b8d59-546c-4b45-98c9-d19cbed92b7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:13.096201 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-419b8d59-546c-4b45-98c9-d19cbed92b7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:13.104765 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-419b8d59-546c-4b45-98c9-d19cbed92b7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:13.106388 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-419b8d59-546c-4b45-98c9-d19cbed92b7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:13.107707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-419b8d59-546c-4b45-98c9-d19cbed92b7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.196718 May 19 12:29:13.108582 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 567/1083] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:12 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:14.128309 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f74c876c-1a38-4105-b031-79284057e414 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:14.128934 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f74c876c-1a38-4105-b031-79284057e414 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:14.136244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f74c876c-1a38-4105-b031-79284057e414 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:14.136721 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f74c876c-1a38-4105-b031-79284057e414 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:14.137524 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f74c876c-1a38-4105-b031-79284057e414 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:14.137969 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f74c876c-1a38-4105-b031-79284057e414 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:14.296824 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f74c876c-1a38-4105-b031-79284057e414 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:14.308623 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f74c876c-1a38-4105-b031-79284057e414 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:14.310603 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f74c876c-1a38-4105-b031-79284057e414 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:14.312270 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f74c876c-1a38-4105-b031-79284057e414 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.187940 May 19 12:29:14.317183 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 517/1084] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:14 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:15.345565 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-201e8d90-4b9e-47d4-b3a9-f382d2a42ff2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:15.347129 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-201e8d90-4b9e-47d4-b3a9-f382d2a42ff2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:15.357272 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-201e8d90-4b9e-47d4-b3a9-f382d2a42ff2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:15.361831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-201e8d90-4b9e-47d4-b3a9-f382d2a42ff2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:15.361831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-201e8d90-4b9e-47d4-b3a9-f382d2a42ff2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:15.361831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-201e8d90-4b9e-47d4-b3a9-f382d2a42ff2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:15.550724 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-201e8d90-4b9e-47d4-b3a9-f382d2a42ff2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:15.560144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-201e8d90-4b9e-47d4-b3a9-f382d2a42ff2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:15.561708 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-201e8d90-4b9e-47d4-b3a9-f382d2a42ff2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:15.562906 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-201e8d90-4b9e-47d4-b3a9-f382d2a42ff2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.224811 May 19 12:29:15.563639 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 568/1085] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:15 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:16.581681 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-4fb4c13a-5b88-44b9-9cc7-180b69b83791 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:16.582795 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-4fb4c13a-5b88-44b9-9cc7-180b69b83791 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:16.591936 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4fb4c13a-5b88-44b9-9cc7-180b69b83791 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:16.592665 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4fb4c13a-5b88-44b9-9cc7-180b69b83791 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:16.594115 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4fb4c13a-5b88-44b9-9cc7-180b69b83791 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:16.594955 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4fb4c13a-5b88-44b9-9cc7-180b69b83791 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:16.800830 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-4fb4c13a-5b88-44b9-9cc7-180b69b83791 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:16.818511 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-4fb4c13a-5b88-44b9-9cc7-180b69b83791 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:16.822288 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-4fb4c13a-5b88-44b9-9cc7-180b69b83791 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:16.826310 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-4fb4c13a-5b88-44b9-9cc7-180b69b83791 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.248219 May 19 12:29:16.827376 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 518/1086] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:16 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:29:17.847311 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8d947751-6c21-41aa-b1e2-1bd00d69fe73 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:17.848097 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8d947751-6c21-41aa-b1e2-1bd00d69fe73 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:17.856292 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8d947751-6c21-41aa-b1e2-1bd00d69fe73 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:17.858872 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8d947751-6c21-41aa-b1e2-1bd00d69fe73 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:17.858872 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8d947751-6c21-41aa-b1e2-1bd00d69fe73 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:17.858872 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8d947751-6c21-41aa-b1e2-1bd00d69fe73 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:18.025649 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8d947751-6c21-41aa-b1e2-1bd00d69fe73 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:18.035465 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8d947751-6c21-41aa-b1e2-1bd00d69fe73 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:18.037013 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8d947751-6c21-41aa-b1e2-1bd00d69fe73 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:18.038233 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8d947751-6c21-41aa-b1e2-1bd00d69fe73 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.196067 May 19 12:29:18.038817 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 569/1087] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:17 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:19.059684 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-22b2d0cd-1631-489c-a809-f92da1c5bbc2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:19.061602 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-22b2d0cd-1631-489c-a809-f92da1c5bbc2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:19.070009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-22b2d0cd-1631-489c-a809-f92da1c5bbc2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:19.070708 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-22b2d0cd-1631-489c-a809-f92da1c5bbc2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:19.071695 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-22b2d0cd-1631-489c-a809-f92da1c5bbc2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:19.072167 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-22b2d0cd-1631-489c-a809-f92da1c5bbc2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:19.236548 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-22b2d0cd-1631-489c-a809-f92da1c5bbc2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:19.245177 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-22b2d0cd-1631-489c-a809-f92da1c5bbc2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:19.246880 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-22b2d0cd-1631-489c-a809-f92da1c5bbc2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:19.248166 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-22b2d0cd-1631-489c-a809-f92da1c5bbc2 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.194465 May 19 12:29:19.248726 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 519/1088] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:19 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:20.267944 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ae97cb5a-b54f-4d44-aa1e-8d90a29c828f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:20.268551 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ae97cb5a-b54f-4d44-aa1e-8d90a29c828f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:20.275927 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae97cb5a-b54f-4d44-aa1e-8d90a29c828f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:20.276466 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae97cb5a-b54f-4d44-aa1e-8d90a29c828f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:20.277669 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae97cb5a-b54f-4d44-aa1e-8d90a29c828f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:20.278172 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae97cb5a-b54f-4d44-aa1e-8d90a29c828f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:20.430053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ae97cb5a-b54f-4d44-aa1e-8d90a29c828f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:20.440003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ae97cb5a-b54f-4d44-aa1e-8d90a29c828f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:20.441498 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ae97cb5a-b54f-4d44-aa1e-8d90a29c828f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:20.442817 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ae97cb5a-b54f-4d44-aa1e-8d90a29c828f tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.178950 May 19 12:29:20.443389 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 570/1089] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:20 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:29:21.461895 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-adcec6e0-2593-4219-b17d-4c21d4510b19 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:21.462827 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-adcec6e0-2593-4219-b17d-4c21d4510b19 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:21.470160 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-adcec6e0-2593-4219-b17d-4c21d4510b19 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:21.476769 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-adcec6e0-2593-4219-b17d-4c21d4510b19 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:21.476769 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-adcec6e0-2593-4219-b17d-4c21d4510b19 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:21.476769 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-adcec6e0-2593-4219-b17d-4c21d4510b19 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:21.476769 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:21.619622 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-adcec6e0-2593-4219-b17d-4c21d4510b19 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:21.628733 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-adcec6e0-2593-4219-b17d-4c21d4510b19 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:21.630244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-adcec6e0-2593-4219-b17d-4c21d4510b19 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:21.631428 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-adcec6e0-2593-4219-b17d-4c21d4510b19 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.173715 May 19 12:29:21.632083 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 520/1090] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:21 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:22.653506 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f206b27a-f4b2-4973-ba4b-1d13b6f875b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:22.654222 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f206b27a-f4b2-4973-ba4b-1d13b6f875b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:22.661412 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f206b27a-f4b2-4973-ba4b-1d13b6f875b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:22.662202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f206b27a-f4b2-4973-ba4b-1d13b6f875b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:22.663111 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f206b27a-f4b2-4973-ba4b-1d13b6f875b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:22.663672 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f206b27a-f4b2-4973-ba4b-1d13b6f875b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:22.820642 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f206b27a-f4b2-4973-ba4b-1d13b6f875b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:22.830193 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f206b27a-f4b2-4973-ba4b-1d13b6f875b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:22.831734 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f206b27a-f4b2-4973-ba4b-1d13b6f875b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:22.832990 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f206b27a-f4b2-4973-ba4b-1d13b6f875b4 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.186182 May 19 12:29:22.833579 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 571/1091] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:22 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:23.853164 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9f63290b-beaf-4169-94f9-9afa0abb98ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:23.854037 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9f63290b-beaf-4169-94f9-9afa0abb98ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:23.861663 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9f63290b-beaf-4169-94f9-9afa0abb98ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:23.862120 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9f63290b-beaf-4169-94f9-9afa0abb98ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:23.862906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9f63290b-beaf-4169-94f9-9afa0abb98ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:23.863342 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9f63290b-beaf-4169-94f9-9afa0abb98ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:24.028507 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9f63290b-beaf-4169-94f9-9afa0abb98ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:24.039441 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9f63290b-beaf-4169-94f9-9afa0abb98ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:24.041062 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9f63290b-beaf-4169-94f9-9afa0abb98ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:24.042330 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9f63290b-beaf-4169-94f9-9afa0abb98ea tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.193510 May 19 12:29:24.043648 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 521/1092] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:23 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:25.061571 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f0bdc551-82fb-442c-b032-ca7bb5acddac tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:25.063054 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f0bdc551-82fb-442c-b032-ca7bb5acddac tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:25.073312 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f0bdc551-82fb-442c-b032-ca7bb5acddac tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:25.073767 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f0bdc551-82fb-442c-b032-ca7bb5acddac tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:25.075496 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f0bdc551-82fb-442c-b032-ca7bb5acddac tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:25.076089 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f0bdc551-82fb-442c-b032-ca7bb5acddac tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:25.282563 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f0bdc551-82fb-442c-b032-ca7bb5acddac tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:25.292339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f0bdc551-82fb-442c-b032-ca7bb5acddac tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:25.294828 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f0bdc551-82fb-442c-b032-ca7bb5acddac tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:25.296369 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f0bdc551-82fb-442c-b032-ca7bb5acddac tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.239484 May 19 12:29:25.297041 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 572/1093] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:25 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:26.326440 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a83958fb-62da-45ab-af30-31cd48996e7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:26.329564 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a83958fb-62da-45ab-af30-31cd48996e7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:26.334723 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a83958fb-62da-45ab-af30-31cd48996e7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:26.335178 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a83958fb-62da-45ab-af30-31cd48996e7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:26.336001 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a83958fb-62da-45ab-af30-31cd48996e7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:26.336442 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a83958fb-62da-45ab-af30-31cd48996e7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:26.525583 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a83958fb-62da-45ab-af30-31cd48996e7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:26.538125 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a83958fb-62da-45ab-af30-31cd48996e7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:26.541539 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a83958fb-62da-45ab-af30-31cd48996e7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:26.542956 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a83958fb-62da-45ab-af30-31cd48996e7d tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.221051 May 19 12:29:26.543718 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 522/1094] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:26 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:29:27.572870 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-dd35461b-ebbb-4053-87e1-c5287084c473 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:27.575094 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-dd35461b-ebbb-4053-87e1-c5287084c473 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:27.585361 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dd35461b-ebbb-4053-87e1-c5287084c473 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:27.585875 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dd35461b-ebbb-4053-87e1-c5287084c473 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:27.586741 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dd35461b-ebbb-4053-87e1-c5287084c473 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:27.587287 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dd35461b-ebbb-4053-87e1-c5287084c473 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:27.611344 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-1efb93a6-4c86-4587-94f6-2280bd1ad691 req-c8e6f38c-d4c2-4031-8703-33f2597cc35a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315fa402-5c50-4d9d-bfba-b2e39a9133ec", "name": "network-vif-plugged", "status": "completed", "tag": "60a88c1e-75f6-4fbf-9da2-da492fbaa3ed"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:29:27.624369 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-1efb93a6-4c86-4587-94f6-2280bd1ad691 req-c8e6f38c-d4c2-4031-8703-33f2597cc35a service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:27.624893 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-1efb93a6-4c86-4587-94f6-2280bd1ad691 req-c8e6f38c-d4c2-4031-8703-33f2597cc35a service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:27.639324 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-1efb93a6-4c86-4587-94f6-2280bd1ad691 req-c8e6f38c-d4c2-4031-8703-33f2597cc35a service nova] Creating event network-vif-plugged:60a88c1e-75f6-4fbf-9da2-da492fbaa3ed for instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec on hv-cinder-80475 May 19 12:29:27.646725 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-1efb93a6-4c86-4587-94f6-2280bd1ad691 req-c8e6f38c-d4c2-4031-8703-33f2597cc35a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123825 May 19 12:29:27.647686 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 573/1095] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:29:27.749917 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-dd35461b-ebbb-4053-87e1-c5287084c473 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:27.759060 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-dd35461b-ebbb-4053-87e1-c5287084c473 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:27.760640 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-dd35461b-ebbb-4053-87e1-c5287084c473 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:27.762256 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-dd35461b-ebbb-4053-87e1-c5287084c473 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.196828 May 19 12:29:27.762744 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 523/1096] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:27 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:29:28.791180 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4adf8d96-8548-4e6d-baaa-5b59951384e8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:28.791810 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4adf8d96-8548-4e6d-baaa-5b59951384e8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:28.799076 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4adf8d96-8548-4e6d-baaa-5b59951384e8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:28.799552 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4adf8d96-8548-4e6d-baaa-5b59951384e8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:28.800358 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4adf8d96-8548-4e6d-baaa-5b59951384e8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:28.800801 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4adf8d96-8548-4e6d-baaa-5b59951384e8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:28.803903 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:28.971827 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4adf8d96-8548-4e6d-baaa-5b59951384e8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:28.981425 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4adf8d96-8548-4e6d-baaa-5b59951384e8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:28.983024 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4adf8d96-8548-4e6d-baaa-5b59951384e8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:28.984498 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4adf8d96-8548-4e6d-baaa-5b59951384e8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.198409 May 19 12:29:28.985140 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 574/1097] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:28 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:29:30.013045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-bc3a2642-f019-4df1-9307-7ff43042e0a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:30.013795 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-bc3a2642-f019-4df1-9307-7ff43042e0a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:30.020914 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bc3a2642-f019-4df1-9307-7ff43042e0a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:30.021363 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bc3a2642-f019-4df1-9307-7ff43042e0a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:30.026127 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bc3a2642-f019-4df1-9307-7ff43042e0a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:30.026127 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bc3a2642-f019-4df1-9307-7ff43042e0a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:30.191914 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-bc3a2642-f019-4df1-9307-7ff43042e0a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:30.201731 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-bc3a2642-f019-4df1-9307-7ff43042e0a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:30.203315 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-bc3a2642-f019-4df1-9307-7ff43042e0a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:30.204585 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-bc3a2642-f019-4df1-9307-7ff43042e0a5 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.196434 May 19 12:29:30.205165 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 524/1098] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:30 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:31.231294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d6c0ba8d-105c-4fcf-b36a-c2da5bd1e8ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:31.232775 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d6c0ba8d-105c-4fcf-b36a-c2da5bd1e8ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:31.246518 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d6c0ba8d-105c-4fcf-b36a-c2da5bd1e8ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:31.247428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d6c0ba8d-105c-4fcf-b36a-c2da5bd1e8ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:31.249024 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d6c0ba8d-105c-4fcf-b36a-c2da5bd1e8ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:31.249921 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d6c0ba8d-105c-4fcf-b36a-c2da5bd1e8ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:31.445319 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d6c0ba8d-105c-4fcf-b36a-c2da5bd1e8ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:31.462033 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d6c0ba8d-105c-4fcf-b36a-c2da5bd1e8ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:31.466836 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d6c0ba8d-105c-4fcf-b36a-c2da5bd1e8ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:31.469276 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d6c0ba8d-105c-4fcf-b36a-c2da5bd1e8ec tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1729 microversion: 2.20 time: 0.246151 May 19 12:29:31.470294 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 575/1099] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:31 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1729 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:32.489357 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-67550182-f5d6-4022-b8c6-474d6dcaa15c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:32.489968 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-67550182-f5d6-4022-b8c6-474d6dcaa15c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:32.491957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=28 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:32.498313 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-67550182-f5d6-4022-b8c6-474d6dcaa15c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:32.498859 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-67550182-f5d6-4022-b8c6-474d6dcaa15c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:32.499991 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-67550182-f5d6-4022-b8c6-474d6dcaa15c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:32.500519 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-67550182-f5d6-4022-b8c6-474d6dcaa15c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:32.642409 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-67550182-f5d6-4022-b8c6-474d6dcaa15c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:32.650981 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-67550182-f5d6-4022-b8c6-474d6dcaa15c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:32.653139 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-67550182-f5d6-4022-b8c6-474d6dcaa15c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:32.654546 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-67550182-f5d6-4022-b8c6-474d6dcaa15c tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1716 microversion: 2.20 time: 0.169769 May 19 12:29:32.655115 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 525/1100] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:29:32 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1716 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:50.106182 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:29:50.107364 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Thu May 19 12:29:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:30:02.485237 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=29 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:02.486019 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=11 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:02.634345 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3ce031b6-59be-4183-9782-26b8ed2fc72e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:02.634885 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3ce031b6-59be-4183-9782-26b8ed2fc72e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:02.641957 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3ce031b6-59be-4183-9782-26b8ed2fc72e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:02.642409 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3ce031b6-59be-4183-9782-26b8ed2fc72e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:02.643196 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3ce031b6-59be-4183-9782-26b8ed2fc72e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:02.643622 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3ce031b6-59be-4183-9782-26b8ed2fc72e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:02.673443 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3ce031b6-59be-4183-9782-26b8ed2fc72e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7/ips" status: 200 len: 150 microversion: 2.1 time: 0.193397 May 19 12:30:02.674029 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 576/1101] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 19 12:30:02 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7/ips => generated 150 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:30:05.566454 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-bcfc3d6b-b40c-4a64-8e0d-c74567ccaf8b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e33602dd-ac72-4017-97df-6c20b73de8d2"}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:30:05.572283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-bcfc3d6b-b40c-4a64-8e0d-c74567ccaf8b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:05.572283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:05.572283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=34 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:05.579453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bcfc3d6b-b40c-4a64-8e0d-c74567ccaf8b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:05.579932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bcfc3d6b-b40c-4a64-8e0d-c74567ccaf8b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:05.580750 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bcfc3d6b-b40c-4a64-8e0d-c74567ccaf8b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:05.581151 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-bcfc3d6b-b40c-4a64-8e0d-c74567ccaf8b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:06.711250 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-bcfc3d6b-b40c-4a64-8e0d-c74567ccaf8b tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "POST /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.152810 May 19 12:30:06.712646 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 526/1102] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 19 12:30:05 2022] POST /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7/os-volume_attachments => generated 194 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:30:15.842385 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4bf81ebc-7c96-4a94-ac6b-0cee9fd2fc3c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:15.842385 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4bf81ebc-7c96-4a94-ac6b-0cee9fd2fc3c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:15.842385 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:15.842385 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=4 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:15.846520 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4bf81ebc-7c96-4a94-ac6b-0cee9fd2fc3c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:15.847083 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4bf81ebc-7c96-4a94-ac6b-0cee9fd2fc3c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:15.848175 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4bf81ebc-7c96-4a94-ac6b-0cee9fd2fc3c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:15.848659 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4bf81ebc-7c96-4a94-ac6b-0cee9fd2fc3c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:15.952645 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-4bf81ebc-7c96-4a94-ac6b-0cee9fd2fc3c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lazy-loading 'services' on Instance uuid 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:30:16.262517 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4bf81ebc-7c96-4a94-ac6b-0cee9fd2fc3c tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7/os-volume_attachments/e33602dd-ac72-4017-97df-6c20b73de8d2" status: 202 len: 0 microversion: 2.1 time: 0.432141 May 19 12:30:16.263632 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 577/1103] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 19 12:30:15 2022] DELETE /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7/os-volume_attachments/e33602dd-ac72-4017-97df-6c20b73de8d2 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:30:16.273927 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=2 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:16.281777 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-3b600cfc-9c8d-4cfa-aa2e-8f91c4ff0961 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:16.283860 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-3b600cfc-9c8d-4cfa-aa2e-8f91c4ff0961 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:16.295164 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3b600cfc-9c8d-4cfa-aa2e-8f91c4ff0961 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:16.297975 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3b600cfc-9c8d-4cfa-aa2e-8f91c4ff0961 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:16.297975 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3b600cfc-9c8d-4cfa-aa2e-8f91c4ff0961 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:16.297975 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-3b600cfc-9c8d-4cfa-aa2e-8f91c4ff0961 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:16.350152 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-3b600cfc-9c8d-4cfa-aa2e-8f91c4ff0961 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079578 May 19 12:30:16.351121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 527/1104] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:30:16 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:30:17.364785 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2f3f4771-98c9-4924-9cb9-a734a412471a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:17.366400 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2f3f4771-98c9-4924-9cb9-a734a412471a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:17.374139 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f3f4771-98c9-4924-9cb9-a734a412471a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:17.374997 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f3f4771-98c9-4924-9cb9-a734a412471a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:17.376006 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f3f4771-98c9-4924-9cb9-a734a412471a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:17.376656 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f3f4771-98c9-4924-9cb9-a734a412471a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:17.417331 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2f3f4771-98c9-4924-9cb9-a734a412471a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051245 May 19 12:30:17.417331 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 578/1105] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:30:17 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:30:18.424750 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6b9aa83b-a0ca-4ffb-9e10-13828d1774c4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:18.426144 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6b9aa83b-a0ca-4ffb-9e10-13828d1774c4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:18.438393 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6b9aa83b-a0ca-4ffb-9e10-13828d1774c4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:18.439137 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6b9aa83b-a0ca-4ffb-9e10-13828d1774c4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:18.440657 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6b9aa83b-a0ca-4ffb-9e10-13828d1774c4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:18.441410 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6b9aa83b-a0ca-4ffb-9e10-13828d1774c4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:18.483122 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6b9aa83b-a0ca-4ffb-9e10-13828d1774c4 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062884 May 19 12:30:18.483844 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 528/1106] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 19 12:30:18 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 12:30:18.556900 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-541d3f09-ce82-4c01-af11-f21684e51dd2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:18.559096 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-541d3f09-ce82-4c01-af11-f21684e51dd2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:18.576665 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-541d3f09-ce82-4c01-af11-f21684e51dd2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:18.577848 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-541d3f09-ce82-4c01-af11-f21684e51dd2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:18.579847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-541d3f09-ce82-4c01-af11-f21684e51dd2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:18.580901 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-541d3f09-ce82-4c01-af11-f21684e51dd2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:18.638220 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-541d3f09-ce82-4c01-af11-f21684e51dd2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:30:19.090233 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-541d3f09-ce82-4c01-af11-f21684e51dd2 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 204 len: 0 microversion: 2.1 time: 0.538002 May 19 12:30:19.090957 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 579/1107] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:30:18 2022] DELETE /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:30:19.100072 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-93ee3636-503a-488f-adfa-92897023c7fb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:19.100685 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-93ee3636-503a-488f-adfa-92897023c7fb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:19.107940 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-93ee3636-503a-488f-adfa-92897023c7fb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:19.108387 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-93ee3636-503a-488f-adfa-92897023c7fb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:19.109163 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-93ee3636-503a-488f-adfa-92897023c7fb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:19.109596 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-93ee3636-503a-488f-adfa-92897023c7fb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:19.270749 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-93ee3636-503a-488f-adfa-92897023c7fb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:19.280973 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-93ee3636-503a-488f-adfa-92897023c7fb tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1682 microversion: 2.1 time: 0.184987 May 19 12:30:19.281917 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 529/1108] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:30:19 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:20.305189 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a0b5e434-2f44-4bf0-8bb9-066c0f95ac13 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:20.305909 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a0b5e434-2f44-4bf0-8bb9-066c0f95ac13 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:20.313314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0b5e434-2f44-4bf0-8bb9-066c0f95ac13 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:20.313775 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0b5e434-2f44-4bf0-8bb9-066c0f95ac13 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:20.314569 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0b5e434-2f44-4bf0-8bb9-066c0f95ac13 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:20.315011 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0b5e434-2f44-4bf0-8bb9-066c0f95ac13 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:20.466355 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a0b5e434-2f44-4bf0-8bb9-066c0f95ac13 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:20.474566 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a0b5e434-2f44-4bf0-8bb9-066c0f95ac13 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1682 microversion: 2.1 time: 0.173572 May 19 12:30:20.475399 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 580/1109] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:30:20 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:21.495734 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-8367e775-4821-4c1a-8735-3151ec9b8790 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:21.496890 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-8367e775-4821-4c1a-8735-3151ec9b8790 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:21.505333 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8367e775-4821-4c1a-8735-3151ec9b8790 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:21.510405 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8367e775-4821-4c1a-8735-3151ec9b8790 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:21.510405 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8367e775-4821-4c1a-8735-3151ec9b8790 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:21.510405 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8367e775-4821-4c1a-8735-3151ec9b8790 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:21.704127 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-8367e775-4821-4c1a-8735-3151ec9b8790 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:21.718247 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-8367e775-4821-4c1a-8735-3151ec9b8790 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1682 microversion: 2.1 time: 0.227178 May 19 12:30:21.732971 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 530/1110] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:30:21 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1682 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:22.741973 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-eab56e01-1908-4c3d-b04f-926ace0ba68e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:22.743641 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-eab56e01-1908-4c3d-b04f-926ace0ba68e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:22.766754 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-eab56e01-1908-4c3d-b04f-926ace0ba68e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:22.767509 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-eab56e01-1908-4c3d-b04f-926ace0ba68e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:22.769437 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-eab56e01-1908-4c3d-b04f-926ace0ba68e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:22.771423 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-eab56e01-1908-4c3d-b04f-926ace0ba68e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:22.952392 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-eab56e01-1908-4c3d-b04f-926ace0ba68e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd39ddcf4ab045b98a737ee529a2dcce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2de86d602945238f5df0e2c388004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:22.959596 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-152b2ff9-204f-49da-95da-80b33adfdb12 req-54df63d4-bf16-4331-b2ff-01250ea140d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4044bf22-d9bc-4d48-b10d-7ad3da39ebd7", "name": "network-vif-deleted", "tag": "20c5c364-3274-4170-8229-3c010171aa57"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:30:22.963180 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-eab56e01-1908-4c3d-b04f-926ace0ba68e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 200 len: 1614 microversion: 2.1 time: 0.225324 May 19 12:30:22.972792 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 531/1111] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:30:22 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 1614 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:22.985207 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-152b2ff9-204f-49da-95da-80b33adfdb12 req-54df63d4-bf16-4331-b2ff-01250ea140d1 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:22.986129 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-152b2ff9-204f-49da-95da-80b33adfdb12 req-54df63d4-bf16-4331-b2ff-01250ea140d1 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:23.009414 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-152b2ff9-204f-49da-95da-80b33adfdb12 req-54df63d4-bf16-4331-b2ff-01250ea140d1 service nova] Creating event network-vif-deleted:20c5c364-3274-4170-8229-3c010171aa57 for instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 on hv-cinder-80475 May 19 12:30:23.018699 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-152b2ff9-204f-49da-95da-80b33adfdb12 req-54df63d4-bf16-4331-b2ff-01250ea140d1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.439758 May 19 12:30:23.022787 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 581/1112] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:30:23.993073 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-38c5427a-7036-4da6-9c7d-6f5d89b0f265 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:23.994119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-38c5427a-7036-4da6-9c7d-6f5d89b0f265 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:24.005593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-38c5427a-7036-4da6-9c7d-6f5d89b0f265 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:24.006391 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-38c5427a-7036-4da6-9c7d-6f5d89b0f265 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:24.007958 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-38c5427a-7036-4da6-9c7d-6f5d89b0f265 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:24.008753 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-38c5427a-7036-4da6-9c7d-6f5d89b0f265 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:24.028650 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-38c5427a-7036-4da6-9c7d-6f5d89b0f265 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] HTTP exception thrown: Instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 could not be found. May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-38c5427a-7036-4da6-9c7d-6f5d89b0f265 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Request method failure captured: May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 HTTP/1.1 May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjWEBNF2DeurAd4vIS9t5sXixknAa9oMvXKGIT7BVlMgRbph3mSe132nYVois5KyltYyb0JHe3nInO6bVt7M3Z2oZ1xRzJyjOamBOcNMxIEvcJ1cyR56gBj_EXYQnPZDcjZT6Ja0FtOHx4Rd4HuWodV9rlQ_CBw1MTfirEySyppbNDw May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:30:24.030676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:30:24.032366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2de86d602945238f5df0e2c388004f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:30:24.032366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:24.032366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:30:24.032366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:24.032366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:30:24.032366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:30:24.032366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:30:24.032366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: dd39ddcf4ab045b98a737ee529a2dcce May 19 12:30:24.032366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:30:24.032366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:30:24.032366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 could not be found. May 19 12:30:24.032366 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': '4044bf22-d9bc-4d48-b10d-7ad3da39ebd7'} May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 could not be found. May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:30:24.033736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:30:24.036154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:30:24.036154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:30:24.036154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:30:24.036154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:30:24.036154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:30:24.036154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:30:24.036154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:30:24.036154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 could not be found. May 19 12:30:24.036154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:24.036154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:24.036154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:24.036154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:24.036154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:24.036154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:24.036154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:30:24.036154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:30:24.036154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 could not be found. May 19 12:30:24.036154 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:24.038619 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-38c5427a-7036-4da6-9c7d-6f5d89b0f265 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Returning 404 to user: Instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:30:24.038619 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-38c5427a-7036-4da6-9c7d-6f5d89b0f265 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 404 len: 111 microversion: 2.1 time: 0.046317 May 19 12:30:24.038619 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 532/1113] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:30:23 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:30:24.045116 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b30b1920-4ae8-4c96-9d46-715d9ef7b5ab tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '.version_select at 0x7f3ba2a12940>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:24.275580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b30b1920-4ae8-4c96-9d46-715d9ef7b5ab tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109007285" status: 202 len: 0 microversion: 2.1 time: 0.236787 May 19 12:30:24.280561 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 582/1114] 10.222.0.23 () {58 vars in 1220 bytes} [Thu May 19 12:30:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109007285 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:30:26.740065 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f46241df-672c-44ff-85b3-705efab31b6a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:26.743451 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f46241df-672c-44ff-85b3-705efab31b6a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:26.752944 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f46241df-672c-44ff-85b3-705efab31b6a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:26.753733 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f46241df-672c-44ff-85b3-705efab31b6a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:26.755307 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f46241df-672c-44ff-85b3-705efab31b6a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:26.756152 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f46241df-672c-44ff-85b3-705efab31b6a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:26.777026 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-f46241df-672c-44ff-85b3-705efab31b6a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] HTTP exception thrown: Instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 could not be found. May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f46241df-672c-44ff-85b3-705efab31b6a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Request method failure captured: May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: DELETE /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 HTTP/1.1 May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjWEBNF2DeurAd4vIS9t5sXixknAa9oMvXKGIT7BVlMgRbph3mSe132nYVois5KyltYyb0JHe3nInO6bVt7M3Z2oZ1xRzJyjOamBOcNMxIEvcJ1cyR56gBj_EXYQnPZDcjZT6Ja0FtOHx4Rd4HuWodV9rlQ_CBw1MTfirEySyppbNDw May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:30:26.785295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:30:26.788179 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2de86d602945238f5df0e2c388004f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:30:26.788179 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:26.788179 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:30:26.788179 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:26.788179 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:30:26.788179 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:30:26.788179 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:30:26.788179 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: dd39ddcf4ab045b98a737ee529a2dcce May 19 12:30:26.788179 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:30:26.788179 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:30:26.788179 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 could not be found. May 19 12:30:26.788179 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': '4044bf22-d9bc-4d48-b10d-7ad3da39ebd7'} May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 could not be found. May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:30:26.790593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 could not be found. May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 could not be found. May 19 12:30:26.794403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:26.796788 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f46241df-672c-44ff-85b3-705efab31b6a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Returning 404 to user: Instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:30:26.796788 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f46241df-672c-44ff-85b3-705efab31b6a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 404 len: 111 microversion: 2.1 time: 0.048297 May 19 12:30:26.796788 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 533/1115] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:30:26 2022] DELETE /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:30:26.803216 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-dcce8851-47ba-445a-b272-9767e457be1a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:26.804456 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-dcce8851-47ba-445a-b272-9767e457be1a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:26.819616 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dcce8851-47ba-445a-b272-9767e457be1a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:26.820479 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dcce8851-47ba-445a-b272-9767e457be1a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:26.821927 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dcce8851-47ba-445a-b272-9767e457be1a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:26.825798 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dcce8851-47ba-445a-b272-9767e457be1a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:26.847915 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-dcce8851-47ba-445a-b272-9767e457be1a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] HTTP exception thrown: Instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 could not be found. May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-dcce8851-47ba-445a-b272-9767e457be1a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Request method failure captured: May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 HTTP/1.1 May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjWEBNF2DeurAd4vIS9t5sXixknAa9oMvXKGIT7BVlMgRbph3mSe132nYVois5KyltYyb0JHe3nInO6bVt7M3Z2oZ1xRzJyjOamBOcNMxIEvcJ1cyR56gBj_EXYQnPZDcjZT6Ja0FtOHx4Rd4HuWodV9rlQ_CBw1MTfirEySyppbNDw May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:30:26.849896 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:30:26.852826 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2de86d602945238f5df0e2c388004f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:30:26.852826 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:26.852826 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:30:26.852826 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:26.852826 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:30:26.852826 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:30:26.852826 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:30:26.852826 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: dd39ddcf4ab045b98a737ee529a2dcce May 19 12:30:26.852826 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:30:26.852826 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:30:26.852826 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 could not be found. May 19 12:30:26.852826 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': '4044bf22-d9bc-4d48-b10d-7ad3da39ebd7'} May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 could not be found. May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:30:26.854976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:30:26.864713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:30:26.864713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:30:26.864713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:30:26.864713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:30:26.864713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:30:26.864713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:30:26.864713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:30:26.864713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 could not be found. May 19 12:30:26.864713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:26.864713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:26.864713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:26.864713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:26.864713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:26.864713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:26.864713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:30:26.864713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:30:26.864713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 could not be found. May 19 12:30:26.864713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:26.870604 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-dcce8851-47ba-445a-b272-9767e457be1a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Returning 404 to user: Instance 4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:30:26.870604 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-dcce8851-47ba-445a-b272-9767e457be1a tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7" status: 404 len: 111 microversion: 2.1 time: 0.062263 May 19 12:30:26.870604 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 583/1116] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:30:26 2022] GET /compute/v2.1/servers/4044bf22-d9bc-4d48-b10d-7ad3da39ebd7 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:30:28.243762 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-36e5b005-ab80-4ba4-82c6-8a85ba5fe9f6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:28.243762 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-36e5b005-ab80-4ba4-82c6-8a85ba5fe9f6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:28.250978 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-36e5b005-ab80-4ba4-82c6-8a85ba5fe9f6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:28.251430 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-36e5b005-ab80-4ba4-82c6-8a85ba5fe9f6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:28.252257 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-36e5b005-ab80-4ba4-82c6-8a85ba5fe9f6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:28.252696 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-36e5b005-ab80-4ba4-82c6-8a85ba5fe9f6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:28.269904 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-36e5b005-ab80-4ba4-82c6-8a85ba5fe9f6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] HTTP exception thrown: Instance ff26d40f-6c63-40a5-af44-a128df79f323 could not be found. May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-36e5b005-ab80-4ba4-82c6-8a85ba5fe9f6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Request method failure captured: May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: DELETE /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 HTTP/1.1 May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjWEBNF2DeurAd4vIS9t5sXixknAa9oMvXKGIT7BVlMgRbph3mSe132nYVois5KyltYyb0JHe3nInO6bVt7M3Z2oZ1xRzJyjOamBOcNMxIEvcJ1cyR56gBj_EXYQnPZDcjZT6Ja0FtOHx4Rd4HuWodV9rlQ_CBw1MTfirEySyppbNDw May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:30:28.272142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:30:28.275182 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2de86d602945238f5df0e2c388004f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:30:28.275182 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:28.275182 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:30:28.275182 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:28.275182 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:30:28.275182 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:30:28.275182 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:30:28.275182 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: dd39ddcf4ab045b98a737ee529a2dcce May 19 12:30:28.275182 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:30:28.275182 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:30:28.275182 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance ff26d40f-6c63-40a5-af44-a128df79f323 could not be found. May 19 12:30:28.275182 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': 'ff26d40f-6c63-40a5-af44-a128df79f323'} May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff26d40f-6c63-40a5-af44-a128df79f323 could not be found. May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:30:28.277118 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff26d40f-6c63-40a5-af44-a128df79f323 could not be found. May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff26d40f-6c63-40a5-af44-a128df79f323 could not be found. May 19 12:30:28.278732 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:28.282590 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-36e5b005-ab80-4ba4-82c6-8a85ba5fe9f6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Returning 404 to user: Instance ff26d40f-6c63-40a5-af44-a128df79f323 could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:30:28.282590 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-36e5b005-ab80-4ba4-82c6-8a85ba5fe9f6 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 404 len: 111 microversion: 2.1 time: 0.035168 May 19 12:30:28.282590 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 534/1117] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:30:28 2022] DELETE /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:30:28.288798 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-da9e803f-f23a-4674-9857-d7d439fde643 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:28.289884 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-da9e803f-f23a-4674-9857-d7d439fde643 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: ff26d40f-6c63-40a5-af44-a128df79f323] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:28.299263 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-da9e803f-f23a-4674-9857-d7d439fde643 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:28.300206 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-da9e803f-f23a-4674-9857-d7d439fde643 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:28.301320 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-da9e803f-f23a-4674-9857-d7d439fde643 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:28.301909 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-da9e803f-f23a-4674-9857-d7d439fde643 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:28.324206 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-da9e803f-f23a-4674-9857-d7d439fde643 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] HTTP exception thrown: Instance ff26d40f-6c63-40a5-af44-a128df79f323 could not be found. May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-da9e803f-f23a-4674-9857-d7d439fde643 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Request method failure captured: May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 HTTP/1.1 May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjWEBNF2DeurAd4vIS9t5sXixknAa9oMvXKGIT7BVlMgRbph3mSe132nYVois5KyltYyb0JHe3nInO6bVt7M3Z2oZ1xRzJyjOamBOcNMxIEvcJ1cyR56gBj_EXYQnPZDcjZT6Ja0FtOHx4Rd4HuWodV9rlQ_CBw1MTfirEySyppbNDw May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:30:28.326053 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:30:28.332406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2de86d602945238f5df0e2c388004f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:30:28.332406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:28.332406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:30:28.332406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:28.332406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:30:28.332406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:30:28.332406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:30:28.332406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: dd39ddcf4ab045b98a737ee529a2dcce May 19 12:30:28.332406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:30:28.332406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:30:28.332406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance ff26d40f-6c63-40a5-af44-a128df79f323 could not be found. May 19 12:30:28.332406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': 'ff26d40f-6c63-40a5-af44-a128df79f323'} May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff26d40f-6c63-40a5-af44-a128df79f323 could not be found. May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:30:28.334128 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:30:28.337032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:30:28.337032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:30:28.337032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:30:28.337032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:30:28.337032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:30:28.337032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:30:28.337032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:30:28.337032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff26d40f-6c63-40a5-af44-a128df79f323 could not be found. May 19 12:30:28.337032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:28.337032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:28.337032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:28.337032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:28.337032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:28.337032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:28.337032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:30:28.337032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:30:28.337032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff26d40f-6c63-40a5-af44-a128df79f323 could not be found. May 19 12:30:28.337032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:28.339905 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-da9e803f-f23a-4674-9857-d7d439fde643 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Returning 404 to user: Instance ff26d40f-6c63-40a5-af44-a128df79f323 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:30:28.339905 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-da9e803f-f23a-4674-9857-d7d439fde643 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323" status: 404 len: 111 microversion: 2.1 time: 0.045846 May 19 12:30:28.339905 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 584/1118] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:30:28 2022] GET /compute/v2.1/servers/ff26d40f-6c63-40a5-af44-a128df79f323 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:30:28.344323 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d441e64d-4a5c-499f-869a-634295bf237e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:28.345263 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d441e64d-4a5c-499f-869a-634295bf237e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:28.357090 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d441e64d-4a5c-499f-869a-634295bf237e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:28.366244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d441e64d-4a5c-499f-869a-634295bf237e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:28.366244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d441e64d-4a5c-499f-869a-634295bf237e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:28.366244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d441e64d-4a5c-499f-869a-634295bf237e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:28.382386 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-d441e64d-4a5c-499f-869a-634295bf237e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] HTTP exception thrown: Instance 8cac13b6-2524-4f4b-879d-0e6723932d04 could not be found. May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d441e64d-4a5c-499f-869a-634295bf237e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Request method failure captured: May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: DELETE /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 HTTP/1.1 May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjWEBNF2DeurAd4vIS9t5sXixknAa9oMvXKGIT7BVlMgRbph3mSe132nYVois5KyltYyb0JHe3nInO6bVt7M3Z2oZ1xRzJyjOamBOcNMxIEvcJ1cyR56gBj_EXYQnPZDcjZT6Ja0FtOHx4Rd4HuWodV9rlQ_CBw1MTfirEySyppbNDw May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:30:28.384009 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:30:28.386455 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2de86d602945238f5df0e2c388004f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:30:28.386455 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:28.386455 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:30:28.386455 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:28.386455 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:30:28.386455 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:30:28.386455 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:30:28.386455 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: dd39ddcf4ab045b98a737ee529a2dcce May 19 12:30:28.386455 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:30:28.386455 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:30:28.386455 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance 8cac13b6-2524-4f4b-879d-0e6723932d04 could not be found. May 19 12:30:28.386455 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': '8cac13b6-2524-4f4b-879d-0e6723932d04'} May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cac13b6-2524-4f4b-879d-0e6723932d04 could not be found. May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:30:28.387932 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cac13b6-2524-4f4b-879d-0e6723932d04 could not be found. May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cac13b6-2524-4f4b-879d-0e6723932d04 could not be found. May 19 12:30:28.390302 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:28.393418 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d441e64d-4a5c-499f-869a-634295bf237e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Returning 404 to user: Instance 8cac13b6-2524-4f4b-879d-0e6723932d04 could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:30:28.393418 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d441e64d-4a5c-499f-869a-634295bf237e tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 404 len: 111 microversion: 2.1 time: 0.049896 May 19 12:30:28.393418 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 535/1119] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:30:28 2022] DELETE /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:30:28.396688 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-942014d2-8572-4c13-8bc4-90b6d93003f3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:28.400652 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-942014d2-8572-4c13-8bc4-90b6d93003f3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 8cac13b6-2524-4f4b-879d-0e6723932d04] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:28.404526 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-942014d2-8572-4c13-8bc4-90b6d93003f3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:28.404970 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-942014d2-8572-4c13-8bc4-90b6d93003f3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:28.405743 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-942014d2-8572-4c13-8bc4-90b6d93003f3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:28.406173 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-942014d2-8572-4c13-8bc4-90b6d93003f3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:28.421214 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-942014d2-8572-4c13-8bc4-90b6d93003f3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] HTTP exception thrown: Instance 8cac13b6-2524-4f4b-879d-0e6723932d04 could not be found. May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-942014d2-8572-4c13-8bc4-90b6d93003f3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Request method failure captured: May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 HTTP/1.1 May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjWEBNF2DeurAd4vIS9t5sXixknAa9oMvXKGIT7BVlMgRbph3mSe132nYVois5KyltYyb0JHe3nInO6bVt7M3Z2oZ1xRzJyjOamBOcNMxIEvcJ1cyR56gBj_EXYQnPZDcjZT6Ja0FtOHx4Rd4HuWodV9rlQ_CBw1MTfirEySyppbNDw May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:30:28.422773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:30:28.425734 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2de86d602945238f5df0e2c388004f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:30:28.425734 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:28.425734 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:30:28.425734 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:28.425734 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:30:28.425734 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:30:28.425734 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:30:28.425734 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: dd39ddcf4ab045b98a737ee529a2dcce May 19 12:30:28.425734 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:30:28.425734 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:30:28.425734 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance 8cac13b6-2524-4f4b-879d-0e6723932d04 could not be found. May 19 12:30:28.425734 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': '8cac13b6-2524-4f4b-879d-0e6723932d04'} May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cac13b6-2524-4f4b-879d-0e6723932d04 could not be found. May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:30:28.427394 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:30:28.430057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:30:28.430057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:30:28.430057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:30:28.430057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:30:28.430057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:30:28.430057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:30:28.430057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:30:28.430057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cac13b6-2524-4f4b-879d-0e6723932d04 could not be found. May 19 12:30:28.430057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:28.430057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:28.430057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:28.430057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:28.430057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:28.430057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:28.430057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:30:28.430057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:30:28.430057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cac13b6-2524-4f4b-879d-0e6723932d04 could not be found. May 19 12:30:28.430057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:28.436601 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-942014d2-8572-4c13-8bc4-90b6d93003f3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Returning 404 to user: Instance 8cac13b6-2524-4f4b-879d-0e6723932d04 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:30:28.436601 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-942014d2-8572-4c13-8bc4-90b6d93003f3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04" status: 404 len: 111 microversion: 2.1 time: 0.032788 May 19 12:30:28.436601 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 585/1120] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:30:28 2022] GET /compute/v2.1/servers/8cac13b6-2524-4f4b-879d-0e6723932d04 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:30:29.828176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f6631e95-8770-462d-ab02-079d27f71e57 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:29.828176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f6631e95-8770-462d-ab02-079d27f71e57 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:29.836299 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f6631e95-8770-462d-ab02-079d27f71e57 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:29.836827 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f6631e95-8770-462d-ab02-079d27f71e57 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:29.837783 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f6631e95-8770-462d-ab02-079d27f71e57 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:29.838882 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f6631e95-8770-462d-ab02-079d27f71e57 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:29.855857 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-f6631e95-8770-462d-ab02-079d27f71e57 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] HTTP exception thrown: Instance 51363d7f-7d31-427b-87c1-fa437e713d85 could not be found. May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f6631e95-8770-462d-ab02-079d27f71e57 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Request method failure captured: May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: DELETE /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 HTTP/1.1 May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjWEBNF2DeurAd4vIS9t5sXixknAa9oMvXKGIT7BVlMgRbph3mSe132nYVois5KyltYyb0JHe3nInO6bVt7M3Z2oZ1xRzJyjOamBOcNMxIEvcJ1cyR56gBj_EXYQnPZDcjZT6Ja0FtOHx4Rd4HuWodV9rlQ_CBw1MTfirEySyppbNDw May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:30:29.857540 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:30:29.860107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2de86d602945238f5df0e2c388004f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:30:29.860107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:29.860107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:30:29.860107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:29.860107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:30:29.860107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:30:29.860107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:30:29.860107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: dd39ddcf4ab045b98a737ee529a2dcce May 19 12:30:29.860107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:30:29.860107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:30:29.860107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance 51363d7f-7d31-427b-87c1-fa437e713d85 could not be found. May 19 12:30:29.860107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': '51363d7f-7d31-427b-87c1-fa437e713d85'} May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51363d7f-7d31-427b-87c1-fa437e713d85 could not be found. May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:30:29.861398 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51363d7f-7d31-427b-87c1-fa437e713d85 could not be found. May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51363d7f-7d31-427b-87c1-fa437e713d85 could not be found. May 19 12:30:29.863341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:29.865453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f6631e95-8770-462d-ab02-079d27f71e57 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Returning 404 to user: Instance 51363d7f-7d31-427b-87c1-fa437e713d85 could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:30:29.865453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f6631e95-8770-462d-ab02-079d27f71e57 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "DELETE /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 404 len: 111 microversion: 2.1 time: 0.037097 May 19 12:30:29.865453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 536/1121] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:30:29 2022] DELETE /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:30:29.868484 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5d29fdd1-35fd-4210-a21c-961576473ef3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:29.869102 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5d29fdd1-35fd-4210-a21c-961576473ef3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] [instance: 51363d7f-7d31-427b-87c1-fa437e713d85] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:29.876704 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5d29fdd1-35fd-4210-a21c-961576473ef3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:29.878296 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5d29fdd1-35fd-4210-a21c-961576473ef3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:29.878296 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5d29fdd1-35fd-4210-a21c-961576473ef3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:29.878592 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5d29fdd1-35fd-4210-a21c-961576473ef3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:29.897688 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-5d29fdd1-35fd-4210-a21c-961576473ef3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] HTTP exception thrown: Instance 51363d7f-7d31-427b-87c1-fa437e713d85 could not be found. May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5d29fdd1-35fd-4210-a21c-961576473ef3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Request method failure captured: May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 HTTP/1.1 May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjWEBNF2DeurAd4vIS9t5sXixknAa9oMvXKGIT7BVlMgRbph3mSe132nYVois5KyltYyb0JHe3nInO6bVt7M3Z2oZ1xRzJyjOamBOcNMxIEvcJ1cyR56gBj_EXYQnPZDcjZT6Ja0FtOHx4Rd4HuWodV9rlQ_CBw1MTfirEySyppbNDw May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:30:29.899505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:30:29.904148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2de86d602945238f5df0e2c388004f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2de86d602945238f5df0e2c388004f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:30:29.904148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:29.904148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 1d2de86d602945238f5df0e2c388004f May 19 12:30:29.904148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-50904330 May 19 12:30:29.904148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:30:29.904148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:30:29.904148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:30:29.904148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: dd39ddcf4ab045b98a737ee529a2dcce May 19 12:30:29.904148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeNegativeTest-50904330-project May 19 12:30:29.904148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:30:29.904148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance 51363d7f-7d31-427b-87c1-fa437e713d85 could not be found. May 19 12:30:29.904148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': '51363d7f-7d31-427b-87c1-fa437e713d85'} May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51363d7f-7d31-427b-87c1-fa437e713d85 could not be found. May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:30:29.905145 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:30:29.907629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:30:29.907629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:30:29.907629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:30:29.907629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:30:29.907629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:30:29.907629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:30:29.907629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:30:29.907629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51363d7f-7d31-427b-87c1-fa437e713d85 could not be found. May 19 12:30:29.907629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:29.907629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:29.907629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:29.907629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:29.907629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:29.907629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:29.907629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:30:29.907629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:30:29.907629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51363d7f-7d31-427b-87c1-fa437e713d85 could not be found. May 19 12:30:29.907629 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:29.909490 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5d29fdd1-35fd-4210-a21c-961576473ef3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] Returning 404 to user: Instance 51363d7f-7d31-427b-87c1-fa437e713d85 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:30:29.909490 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5d29fdd1-35fd-4210-a21c-961576473ef3 tempest-AttachVolumeNegativeTest-50904330 tempest-AttachVolumeNegativeTest-50904330-project] 10.222.0.23 "GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85" status: 404 len: 111 microversion: 2.1 time: 0.036640 May 19 12:30:29.909490 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 586/1122] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:30:29 2022] GET /compute/v2.1/servers/51363d7f-7d31-427b-87c1-fa437e713d85 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:30:40.242827 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-debceb2c-48be-4376-81e9-424c836e7d31 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:40.243767 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-debceb2c-48be-4376-81e9-424c836e7d31 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:40.250176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=20 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:40.251216 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:40.253736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-debceb2c-48be-4376-81e9-424c836e7d31 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:40.254501 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-debceb2c-48be-4376-81e9-424c836e7d31 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:40.256064 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-debceb2c-48be-4376-81e9-424c836e7d31 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:40.256064 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-debceb2c-48be-4376-81e9-424c836e7d31 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:40.320039 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-debceb2c-48be-4376-81e9-424c836e7d31 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.081454 May 19 12:30:40.320948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 537/1123] 10.222.0.23 () {60 vars in 1342 bytes} [Thu May 19 12:30:40 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:40.422622 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-68534bf3-d5e7-46ee-95de-9991f61f09b6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:40.426072 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-68534bf3-d5e7-46ee-95de-9991f61f09b6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:40.430444 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:40.431710 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:40.439261 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-68534bf3-d5e7-46ee-95de-9991f61f09b6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:40.441000 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-68534bf3-d5e7-46ee-95de-9991f61f09b6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:40.443025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-68534bf3-d5e7-46ee-95de-9991f61f09b6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:40.446685 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-68534bf3-d5e7-46ee-95de-9991f61f09b6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:40.483295 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-68534bf3-d5e7-46ee-95de-9991f61f09b6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:30:41.051000 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-68534bf3-d5e7-46ee-95de-9991f61f09b6 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "DELETE /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 204 len: 0 microversion: 2.20 time: 0.635072 May 19 12:30:41.052078 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 587/1124] 10.222.0.23 () {60 vars in 1279 bytes} [Thu May 19 12:30:40 2022] DELETE /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 0 bytes in 638 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 12:30:41.066656 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c4b6ca66-7342-403f-a7c1-f23b0d1e9b39 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:41.067693 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c4b6ca66-7342-403f-a7c1-f23b0d1e9b39 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:41.083356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c4b6ca66-7342-403f-a7c1-f23b0d1e9b39 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:41.084442 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c4b6ca66-7342-403f-a7c1-f23b0d1e9b39 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:41.086131 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c4b6ca66-7342-403f-a7c1-f23b0d1e9b39 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:41.087031 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c4b6ca66-7342-403f-a7c1-f23b0d1e9b39 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:41.292242 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c4b6ca66-7342-403f-a7c1-f23b0d1e9b39 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:41.311603 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c4b6ca66-7342-403f-a7c1-f23b0d1e9b39 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:41.313380 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c4b6ca66-7342-403f-a7c1-f23b0d1e9b39 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:41.314662 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c4b6ca66-7342-403f-a7c1-f23b0d1e9b39 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1722 microversion: 2.20 time: 0.255575 May 19 12:30:41.315232 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 538/1125] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:30:41 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:30:42.348883 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8228ee67-9f45-461a-92c5-16028714c184 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:42.350410 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8228ee67-9f45-461a-92c5-16028714c184 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:42.385622 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8228ee67-9f45-461a-92c5-16028714c184 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:42.388335 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8228ee67-9f45-461a-92c5-16028714c184 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:42.392713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8228ee67-9f45-461a-92c5-16028714c184 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:42.394648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8228ee67-9f45-461a-92c5-16028714c184 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:42.680462 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8228ee67-9f45-461a-92c5-16028714c184 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:42.693079 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8228ee67-9f45-461a-92c5-16028714c184 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:42.695468 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8228ee67-9f45-461a-92c5-16028714c184 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:42.699247 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8228ee67-9f45-461a-92c5-16028714c184 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1722 microversion: 2.20 time: 0.366409 May 19 12:30:42.700087 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 588/1126] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:30:42 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1722 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:30:43.734069 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d7064e4c-4e46-46b7-8747-f626249aa057 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:43.736979 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d7064e4c-4e46-46b7-8747-f626249aa057 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:43.767552 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d7064e4c-4e46-46b7-8747-f626249aa057 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:43.769471 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d7064e4c-4e46-46b7-8747-f626249aa057 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:43.777541 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d7064e4c-4e46-46b7-8747-f626249aa057 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:43.781922 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d7064e4c-4e46-46b7-8747-f626249aa057 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:43.929379 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d7064e4c-4e46-46b7-8747-f626249aa057 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:43.942359 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d7064e4c-4e46-46b7-8747-f626249aa057 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:43.944211 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d7064e4c-4e46-46b7-8747-f626249aa057 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:43.948601 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d7064e4c-4e46-46b7-8747-f626249aa057 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1654 microversion: 2.20 time: 0.229831 May 19 12:30:43.948601 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 539/1127] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:30:43 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1654 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:30:44.294156 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-ef0f3bc3-23ed-4b9b-99d2-92f9418e9e8f req-d1f0a887-e07c-4bda-8d0a-934668619570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315fa402-5c50-4d9d-bfba-b2e39a9133ec", "name": "network-vif-deleted", "tag": "60a88c1e-75f6-4fbf-9da2-da492fbaa3ed"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:30:44.313713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-ef0f3bc3-23ed-4b9b-99d2-92f9418e9e8f req-d1f0a887-e07c-4bda-8d0a-934668619570 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:44.314875 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-ef0f3bc3-23ed-4b9b-99d2-92f9418e9e8f req-d1f0a887-e07c-4bda-8d0a-934668619570 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:44.340722 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-ef0f3bc3-23ed-4b9b-99d2-92f9418e9e8f req-d1f0a887-e07c-4bda-8d0a-934668619570 service nova] Creating event network-vif-deleted:60a88c1e-75f6-4fbf-9da2-da492fbaa3ed for instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec on hv-cinder-80475 May 19 12:30:44.351589 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-ef0f3bc3-23ed-4b9b-99d2-92f9418e9e8f req-d1f0a887-e07c-4bda-8d0a-934668619570 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072690 May 19 12:30:44.364278 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 589/1128] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:30:44.994332 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-08c866ab-5981-495a-8bda-d5b8d2ca61f8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:44.995351 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-08c866ab-5981-495a-8bda-d5b8d2ca61f8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:45.011654 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-08c866ab-5981-495a-8bda-d5b8d2ca61f8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:45.012511 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-08c866ab-5981-495a-8bda-d5b8d2ca61f8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:45.013661 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-08c866ab-5981-495a-8bda-d5b8d2ca61f8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:45.014369 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-08c866ab-5981-495a-8bda-d5b8d2ca61f8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:45.078079 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-08c866ab-5981-495a-8bda-d5b8d2ca61f8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:45.078890 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-08c866ab-5981-495a-8bda-d5b8d2ca61f8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:45.079570 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.objects.instance [None req-08c866ab-5981-495a-8bda-d5b8d2ca61f8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lazy-loading 'fault' on Instance uuid 315fa402-5c50-4d9d-bfba-b2e39a9133ec {{(pid=117964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:30:45.138783 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-08c866ab-5981-495a-8bda-d5b8d2ca61f8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:45.155652 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-08c866ab-5981-495a-8bda-d5b8d2ca61f8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:45.159614 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-08c866ab-5981-495a-8bda-d5b8d2ca61f8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cdc4cc4d83b4495aa44de70147a001c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1952e5f71bb245de912a1249fd7f6167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:45.163584 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-08c866ab-5981-495a-8bda-d5b8d2ca61f8 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 200 len: 1369 microversion: 2.20 time: 0.178517 May 19 12:30:45.165203 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 540/1129] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:30:44 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 1369 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:30:46.192917 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9486b618-300a-44c4-9462-b0c0e3c1c28a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:46.194147 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9486b618-300a-44c4-9462-b0c0e3c1c28a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:46.220906 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9486b618-300a-44c4-9462-b0c0e3c1c28a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:46.221697 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9486b618-300a-44c4-9462-b0c0e3c1c28a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:46.223905 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9486b618-300a-44c4-9462-b0c0e3c1c28a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:46.224980 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9486b618-300a-44c4-9462-b0c0e3c1c28a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:46.252430 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-9486b618-300a-44c4-9462-b0c0e3c1c28a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] HTTP exception thrown: Instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec could not be found. May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9486b618-300a-44c4-9462-b0c0e3c1c28a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Request method failure captured: May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec HTTP/1.1 May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjX3N508CfDjsmLKRPHzYw1H4OXVLk2qEHIkh1YpnoBEsMHk0TUwiaWh7zVeV31Tf5zgvDfHiCup9QoxosUe_PEzfDcrOEujHxU0myHR7Sx7cWffxMvj4aW4rxicJDecqp1zd8m9FrH8aeYF6tpKTCoDZ_8CAPEfkzsUUPlULHWsTbA May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Openstack-Nova-Api-Version: 2.20 May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 1952e5f71bb245de912a1249fd7f6167 May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1044180776 May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:30:46.256052 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:30:46.259351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:30:46.259351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1044180776 May 19 12:30:46.259351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 1952e5f71bb245de912a1249fd7f6167 May 19 12:30:46.259351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1044180776 May 19 12:30:46.259351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeShelveTestJSON-1044180776-project May 19 12:30:46.259351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:30:46.259351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:30:46.259351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: 3cdc4cc4d83b4495aa44de70147a001c May 19 12:30:46.259351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1044180776-project May 19 12:30:46.259351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:30:46.259351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec could not be found. May 19 12:30:46.259351 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': '315fa402-5c50-4d9d-bfba-b2e39a9133ec'} May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec could not be found. May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:30:46.261025 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:30:46.263126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:30:46.263126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:30:46.263126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:30:46.263126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:30:46.263126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:30:46.263126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:30:46.263126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:30:46.263126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec could not be found. May 19 12:30:46.263126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:46.263126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:46.263126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:46.263126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:46.263126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:46.263126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:46.263126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:30:46.263126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:30:46.263126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec could not be found. May 19 12:30:46.263126 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:46.269476 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9486b618-300a-44c4-9462-b0c0e3c1c28a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Returning 404 to user: Instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:30:46.269476 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9486b618-300a-44c4-9462-b0c0e3c1c28a tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 404 len: 111 microversion: 2.20 time: 0.080864 May 19 12:30:46.271475 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 590/1130] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:30:46 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 19 12:30:46.282056 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-74544547-7606-4477-a360-0c0a7cff00bc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '.version_select at 0x7f3b9da1d9d0>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:46.445129 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-74544547-7606-4477-a360-0c0a7cff00bc tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-774272841" status: 204 len: 0 microversion: 2.20 time: 0.167222 May 19 12:30:46.445725 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 541/1131] 10.222.0.23 () {60 vars in 1258 bytes} [Thu May 19 12:30:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-774272841 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 12:30:49.537820 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-cabc00c9-6d99-4e15-9540-1eb3aef1c9b7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:49.540001 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-cabc00c9-6d99-4e15-9540-1eb3aef1c9b7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:49.552462 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cabc00c9-6d99-4e15-9540-1eb3aef1c9b7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:49.553270 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cabc00c9-6d99-4e15-9540-1eb3aef1c9b7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:49.554723 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cabc00c9-6d99-4e15-9540-1eb3aef1c9b7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:49.555506 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cabc00c9-6d99-4e15-9540-1eb3aef1c9b7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:49.585319 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-cabc00c9-6d99-4e15-9540-1eb3aef1c9b7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] HTTP exception thrown: Instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec could not be found. May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-cabc00c9-6d99-4e15-9540-1eb3aef1c9b7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Request method failure captured: May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: DELETE /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec HTTP/1.1 May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjX3N508CfDjsmLKRPHzYw1H4OXVLk2qEHIkh1YpnoBEsMHk0TUwiaWh7zVeV31Tf5zgvDfHiCup9QoxosUe_PEzfDcrOEujHxU0myHR7Sx7cWffxMvj4aW4rxicJDecqp1zd8m9FrH8aeYF6tpKTCoDZ_8CAPEfkzsUUPlULHWsTbA May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Openstack-Nova-Api-Version: 2.20 May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 1952e5f71bb245de912a1249fd7f6167 May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1044180776 May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:30:49.588317 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:30:49.590978 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:30:49.590978 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1044180776 May 19 12:30:49.590978 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 1952e5f71bb245de912a1249fd7f6167 May 19 12:30:49.590978 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1044180776 May 19 12:30:49.590978 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeShelveTestJSON-1044180776-project May 19 12:30:49.590978 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:30:49.590978 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:30:49.590978 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: 3cdc4cc4d83b4495aa44de70147a001c May 19 12:30:49.590978 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1044180776-project May 19 12:30:49.590978 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:30:49.590978 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec could not be found. May 19 12:30:49.590978 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': '315fa402-5c50-4d9d-bfba-b2e39a9133ec'} May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec could not be found. May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:30:49.592463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec could not be found. May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec could not be found. May 19 12:30:49.595359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:49.598278 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-cabc00c9-6d99-4e15-9540-1eb3aef1c9b7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Returning 404 to user: Instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:30:49.598278 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-cabc00c9-6d99-4e15-9540-1eb3aef1c9b7 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "DELETE /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 404 len: 111 microversion: 2.20 time: 0.061303 May 19 12:30:49.598278 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 591/1132] 10.222.0.23 () {60 vars in 1279 bytes} [Thu May 19 12:30:49 2022] DELETE /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 12:30:49.605802 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b9306dbc-4327-4055-b381-3b9789e47939 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:49.606838 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-b9306dbc-4327-4055-b381-3b9789e47939 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: 315fa402-5c50-4d9d-bfba-b2e39a9133ec] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:49.615986 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b9306dbc-4327-4055-b381-3b9789e47939 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:49.617881 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b9306dbc-4327-4055-b381-3b9789e47939 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:49.617881 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b9306dbc-4327-4055-b381-3b9789e47939 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:49.617881 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b9306dbc-4327-4055-b381-3b9789e47939 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:49.635091 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-b9306dbc-4327-4055-b381-3b9789e47939 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] HTTP exception thrown: Instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec could not be found. May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b9306dbc-4327-4055-b381-3b9789e47939 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Request method failure captured: May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec HTTP/1.1 May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjX3N508CfDjsmLKRPHzYw1H4OXVLk2qEHIkh1YpnoBEsMHk0TUwiaWh7zVeV31Tf5zgvDfHiCup9QoxosUe_PEzfDcrOEujHxU0myHR7Sx7cWffxMvj4aW4rxicJDecqp1zd8m9FrH8aeYF6tpKTCoDZ_8CAPEfkzsUUPlULHWsTbA May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Openstack-Nova-Api-Version: 2.20 May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 1952e5f71bb245de912a1249fd7f6167 May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1044180776 May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:30:49.637212 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:30:49.640357 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:30:49.640357 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1044180776 May 19 12:30:49.640357 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 1952e5f71bb245de912a1249fd7f6167 May 19 12:30:49.640357 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1044180776 May 19 12:30:49.640357 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-AttachVolumeShelveTestJSON-1044180776-project May 19 12:30:49.640357 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:30:49.640357 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:30:49.640357 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: 3cdc4cc4d83b4495aa44de70147a001c May 19 12:30:49.640357 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1044180776-project May 19 12:30:49.640357 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:30:49.640357 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec could not be found. May 19 12:30:49.640357 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': '315fa402-5c50-4d9d-bfba-b2e39a9133ec'} May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec could not be found. May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:30:49.642193 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:30:49.644993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:30:49.644993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:30:49.644993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:30:49.644993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:30:49.644993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:30:49.644993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:30:49.644993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:30:49.644993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec could not be found. May 19 12:30:49.644993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:49.644993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:49.644993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:49.644993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:49.644993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:49.644993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:49.644993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:30:49.644993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:30:49.644993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec could not be found. May 19 12:30:49.644993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:49.647190 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b9306dbc-4327-4055-b381-3b9789e47939 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Returning 404 to user: Instance 315fa402-5c50-4d9d-bfba-b2e39a9133ec could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:30:49.647190 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b9306dbc-4327-4055-b381-3b9789e47939 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec" status: 404 len: 111 microversion: 2.20 time: 0.039970 May 19 12:30:49.647190 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 542/1133] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:30:49 2022] GET /compute/v2.1/servers/315fa402-5c50-4d9d-bfba-b2e39a9133ec => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 12:30:51.057814 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-db9cd403-bda2-4f7c-a15d-f76f35a9d255 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:51.058469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-db9cd403-bda2-4f7c-a15d-f76f35a9d255 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:51.069110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-db9cd403-bda2-4f7c-a15d-f76f35a9d255 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:51.069924 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-db9cd403-bda2-4f7c-a15d-f76f35a9d255 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:51.071309 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-db9cd403-bda2-4f7c-a15d-f76f35a9d255 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:51.072144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-db9cd403-bda2-4f7c-a15d-f76f35a9d255 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:51.091010 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-db9cd403-bda2-4f7c-a15d-f76f35a9d255 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] HTTP exception thrown: Instance aedab7fb-ae90-48e1-8745-626d60c88a1a could not be found. May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-db9cd403-bda2-4f7c-a15d-f76f35a9d255 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Request method failure captured: May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: DELETE /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a HTTP/1.1 May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjX3N508CfDjsmLKRPHzYw1H4OXVLk2qEHIkh1YpnoBEsMHk0TUwiaWh7zVeV31Tf5zgvDfHiCup9QoxosUe_PEzfDcrOEujHxU0myHR7Sx7cWffxMvj4aW4rxicJDecqp1zd8m9FrH8aeYF6tpKTCoDZ_8CAPEfkzsUUPlULHWsTbA May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Openstack-Nova-Api-Version: 2.20 May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 1952e5f71bb245de912a1249fd7f6167 May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1044180776 May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:30:51.095717 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:30:51.098402 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:30:51.098402 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1044180776 May 19 12:30:51.098402 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 1952e5f71bb245de912a1249fd7f6167 May 19 12:30:51.098402 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1044180776 May 19 12:30:51.098402 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeShelveTestJSON-1044180776-project May 19 12:30:51.098402 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:30:51.098402 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:30:51.098402 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: 3cdc4cc4d83b4495aa44de70147a001c May 19 12:30:51.098402 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1044180776-project May 19 12:30:51.098402 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:30:51.098402 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance aedab7fb-ae90-48e1-8745-626d60c88a1a could not be found. May 19 12:30:51.098402 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': 'aedab7fb-ae90-48e1-8745-626d60c88a1a'} May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aedab7fb-ae90-48e1-8745-626d60c88a1a could not be found. May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:30:51.099758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aedab7fb-ae90-48e1-8745-626d60c88a1a could not be found. May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aedab7fb-ae90-48e1-8745-626d60c88a1a could not be found. May 19 12:30:51.101930 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:30:51.104278 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-db9cd403-bda2-4f7c-a15d-f76f35a9d255 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Returning 404 to user: Instance aedab7fb-ae90-48e1-8745-626d60c88a1a could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:30:51.104278 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-db9cd403-bda2-4f7c-a15d-f76f35a9d255 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 404 len: 111 microversion: 2.20 time: 0.040718 May 19 12:30:51.104278 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 592/1134] 10.222.0.23 () {60 vars in 1279 bytes} [Thu May 19 12:30:51 2022] DELETE /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 19 12:30:51.106544 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e3b9be09-ae43-4d29-9513-c54e4df9d4a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:51.107269 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e3b9be09-ae43-4d29-9513-c54e4df9d4a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] [instance: aedab7fb-ae90-48e1-8745-626d60c88a1a] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:51.114940 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e3b9be09-ae43-4d29-9513-c54e4df9d4a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:51.115639 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e3b9be09-ae43-4d29-9513-c54e4df9d4a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:51.116554 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e3b9be09-ae43-4d29-9513-c54e4df9d4a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:51.117057 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e3b9be09-ae43-4d29-9513-c54e4df9d4a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:51.132493 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-e3b9be09-ae43-4d29-9513-c54e4df9d4a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] HTTP exception thrown: Instance aedab7fb-ae90-48e1-8745-626d60c88a1a could not be found. May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e3b9be09-ae43-4d29-9513-c54e4df9d4a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Request method failure captured: May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a HTTP/1.1 May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjX3N508CfDjsmLKRPHzYw1H4OXVLk2qEHIkh1YpnoBEsMHk0TUwiaWh7zVeV31Tf5zgvDfHiCup9QoxosUe_PEzfDcrOEujHxU0myHR7Sx7cWffxMvj4aW4rxicJDecqp1zd8m9FrH8aeYF6tpKTCoDZ_8CAPEfkzsUUPlULHWsTbA May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Openstack-Nova-Api-Version: 2.20 May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 1952e5f71bb245de912a1249fd7f6167 May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1044180776 May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:30:51.134172 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:30:51.137826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1952e5f71bb245de912a1249fd7f6167"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:30:51.137826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1044180776 May 19 12:30:51.137826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 1952e5f71bb245de912a1249fd7f6167 May 19 12:30:51.137826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1044180776 May 19 12:30:51.137826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-AttachVolumeShelveTestJSON-1044180776-project May 19 12:30:51.137826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:30:51.137826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:30:51.137826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: 3cdc4cc4d83b4495aa44de70147a001c May 19 12:30:51.137826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1044180776-project May 19 12:30:51.137826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:30:51.137826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance aedab7fb-ae90-48e1-8745-626d60c88a1a could not be found. May 19 12:30:51.137826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': 'aedab7fb-ae90-48e1-8745-626d60c88a1a'} May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aedab7fb-ae90-48e1-8745-626d60c88a1a could not be found. May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:30:51.139496 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:30:51.143092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:30:51.143092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:30:51.143092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:30:51.143092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:30:51.143092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:30:51.143092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:30:51.143092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:30:51.143092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aedab7fb-ae90-48e1-8745-626d60c88a1a could not be found. May 19 12:30:51.143092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:51.143092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:51.143092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:51.143092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:51.143092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:51.143092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:51.143092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:30:51.143092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:30:51.143092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aedab7fb-ae90-48e1-8745-626d60c88a1a could not be found. May 19 12:30:51.143092 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:30:51.146273 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e3b9be09-ae43-4d29-9513-c54e4df9d4a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] Returning 404 to user: Instance aedab7fb-ae90-48e1-8745-626d60c88a1a could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:30:51.146273 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e3b9be09-ae43-4d29-9513-c54e4df9d4a3 tempest-AttachVolumeShelveTestJSON-1044180776 tempest-AttachVolumeShelveTestJSON-1044180776-project] 10.222.0.23 "GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a" status: 404 len: 111 microversion: 2.20 time: 0.036193 May 19 12:30:51.146273 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 543/1135] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 19 12:30:51 2022] GET /compute/v2.1/servers/aedab7fb-ae90-48e1-8745-626d60c88a1a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 19 12:30:54.441804 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f8e5248a-bc22-4b06-afde-288924d9bc8d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:54.442729 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f8e5248a-bc22-4b06-afde-288924d9bc8d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:54.451475 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f8e5248a-bc22-4b06-afde-288924d9bc8d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:54.452251 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f8e5248a-bc22-4b06-afde-288924d9bc8d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:54.454229 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f8e5248a-bc22-4b06-afde-288924d9bc8d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:54.454962 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f8e5248a-bc22-4b06-afde-288924d9bc8d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:54.510821 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f8e5248a-bc22-4b06-afde-288924d9bc8d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:30:54.971412 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f8e5248a-bc22-4b06-afde-288924d9bc8d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 204 len: 0 microversion: 2.1 time: 0.533458 May 19 12:30:54.972475 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 593/1136] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:30:54 2022] DELETE /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 12:30:54.992854 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ba111960-2f29-48c8-99ee-5ccc88a7706b tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:54.994427 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ba111960-2f29-48c8-99ee-5ccc88a7706b tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:55.008018 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ba111960-2f29-48c8-99ee-5ccc88a7706b tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:55.008018 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ba111960-2f29-48c8-99ee-5ccc88a7706b tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:55.008018 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ba111960-2f29-48c8-99ee-5ccc88a7706b tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:55.008018 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ba111960-2f29-48c8-99ee-5ccc88a7706b tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:55.293487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ba111960-2f29-48c8-99ee-5ccc88a7706b tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:55.302908 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ba111960-2f29-48c8-99ee-5ccc88a7706b tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1579 microversion: 2.1 time: 0.324379 May 19 12:30:55.303502 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 544/1137] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:30:54 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1579 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:56.322257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3533a336-56e8-4564-ba6c-d3327c65f851 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:56.323825 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3533a336-56e8-4564-ba6c-d3327c65f851 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:56.331532 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3533a336-56e8-4564-ba6c-d3327c65f851 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:56.332054 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3533a336-56e8-4564-ba6c-d3327c65f851 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:56.332990 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3533a336-56e8-4564-ba6c-d3327c65f851 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:56.333436 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3533a336-56e8-4564-ba6c-d3327c65f851 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:56.506367 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3533a336-56e8-4564-ba6c-d3327c65f851 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:56.526092 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3533a336-56e8-4564-ba6c-d3327c65f851 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1579 microversion: 2.1 time: 0.206963 May 19 12:30:56.545201 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 594/1138] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:30:56 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1579 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:57.564037 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-77a9496a-056d-4fc0-a5f0-b7b8bbd8da47 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:57.564825 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-77a9496a-056d-4fc0-a5f0-b7b8bbd8da47 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:57.572131 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-77a9496a-056d-4fc0-a5f0-b7b8bbd8da47 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:57.572777 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-77a9496a-056d-4fc0-a5f0-b7b8bbd8da47 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:57.573868 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-77a9496a-056d-4fc0-a5f0-b7b8bbd8da47 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:57.574315 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-77a9496a-056d-4fc0-a5f0-b7b8bbd8da47 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:58.048530 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-77a9496a-056d-4fc0-a5f0-b7b8bbd8da47 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:58.066688 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-77a9496a-056d-4fc0-a5f0-b7b8bbd8da47 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1512 microversion: 2.1 time: 0.505079 May 19 12:30:58.067651 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 545/1139] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:30:57 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1512 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:58.299635 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-582950bf-aebb-436e-b23e-9d736d2d2f51 req-676d5f6f-82f4-4e48-ad26-0a2d695c3996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5e1226-df90-46cb-b63b-38a15848fa99", "name": "network-vif-deleted", "tag": "8f049042-efb1-4f34-b024-4e6aa097edab"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:30:58.341076 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-582950bf-aebb-436e-b23e-9d736d2d2f51 req-676d5f6f-82f4-4e48-ad26-0a2d695c3996 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:58.342312 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-582950bf-aebb-436e-b23e-9d736d2d2f51 req-676d5f6f-82f4-4e48-ad26-0a2d695c3996 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:58.377592 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-582950bf-aebb-436e-b23e-9d736d2d2f51 req-676d5f6f-82f4-4e48-ad26-0a2d695c3996 service nova] Creating event network-vif-deleted:8f049042-efb1-4f34-b024-4e6aa097edab for instance fd5e1226-df90-46cb-b63b-38a15848fa99 on hv-cinder-80475 May 19 12:30:58.389200 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-582950bf-aebb-436e-b23e-9d736d2d2f51 req-676d5f6f-82f4-4e48-ad26-0a2d695c3996 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102428 May 19 12:30:58.391711 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 595/1140] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:30:59.094912 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-02f59a52-dcd0-4f6e-b178-3632d3bafab1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:59.095524 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-02f59a52-dcd0-4f6e-b178-3632d3bafab1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:59.103146 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-02f59a52-dcd0-4f6e-b178-3632d3bafab1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:59.103146 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-02f59a52-dcd0-4f6e-b178-3632d3bafab1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:59.104644 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-02f59a52-dcd0-4f6e-b178-3632d3bafab1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:59.104865 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-02f59a52-dcd0-4f6e-b178-3632d3bafab1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:59.182066 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-02f59a52-dcd0-4f6e-b178-3632d3bafab1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:59.191517 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-02f59a52-dcd0-4f6e-b178-3632d3bafab1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1226 microversion: 2.1 time: 0.101109 May 19 12:30:59.192622 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 546/1141] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:30:59 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:00.212648 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e901e5d5-30dc-4657-95c6-652cdd72e068 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:00.214776 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e901e5d5-30dc-4657-95c6-652cdd72e068 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:00.221618 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e901e5d5-30dc-4657-95c6-652cdd72e068 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:00.222076 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e901e5d5-30dc-4657-95c6-652cdd72e068 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:00.223903 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e901e5d5-30dc-4657-95c6-652cdd72e068 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:00.223903 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e901e5d5-30dc-4657-95c6-652cdd72e068 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:00.267378 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e901e5d5-30dc-4657-95c6-652cdd72e068 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:00.267942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e901e5d5-30dc-4657-95c6-652cdd72e068 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:00.268474 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-e901e5d5-30dc-4657-95c6-652cdd72e068 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lazy-loading 'fault' on Instance uuid fd5e1226-df90-46cb-b63b-38a15848fa99 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:31:00.326018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e901e5d5-30dc-4657-95c6-652cdd72e068 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:00.335588 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e901e5d5-30dc-4657-95c6-652cdd72e068 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 200 len: 1231 microversion: 2.1 time: 0.127407 May 19 12:31:00.336609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 596/1142] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:00 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 1231 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:01.355452 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-461ffae6-c078-49ff-904f-ecdfcfa34ced tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:01.356869 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-461ffae6-c078-49ff-904f-ecdfcfa34ced tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:01.364883 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-461ffae6-c078-49ff-904f-ecdfcfa34ced tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:01.365870 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-461ffae6-c078-49ff-904f-ecdfcfa34ced tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:01.366934 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-461ffae6-c078-49ff-904f-ecdfcfa34ced tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:01.367587 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-461ffae6-c078-49ff-904f-ecdfcfa34ced tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:01.383697 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-461ffae6-c078-49ff-904f-ecdfcfa34ced tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] HTTP exception thrown: Instance fd5e1226-df90-46cb-b63b-38a15848fa99 could not be found. May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-461ffae6-c078-49ff-904f-ecdfcfa34ced tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Request method failure captured: May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 HTTP/1.1 May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjeC2Em27PMp9Af2Y9rGUH2CGe7aXy_xBl2gaNgyc_fui5CRQJGgecuBicS5LhxjRGHyAdcG99UTAqjXcnhWRudO655qCHQ2_XKadQhcHqubtpN2Zh1FImipSVjvWb934hApgz0HundRUQITGibgYmIY7pTw3bDvFr9XflzI5ue9Sc4 May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 4b46044a7f1d471582800c9d8a79e5c5 May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-TestVolumeBootPattern-614865877 May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:31:01.385847 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:31:01.387730 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:31:01.387730 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-TestVolumeBootPattern-614865877 May 19 12:31:01.387730 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 4b46044a7f1d471582800c9d8a79e5c5 May 19 12:31:01.387730 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-TestVolumeBootPattern-614865877 May 19 12:31:01.387730 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-TestVolumeBootPattern-614865877-project May 19 12:31:01.387730 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:31:01.387730 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:31:01.387730 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: 2d158b01a0a74de4bc0131b5c625efdf May 19 12:31:01.387730 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-TestVolumeBootPattern-614865877-project May 19 12:31:01.387730 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:31:01.387730 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance fd5e1226-df90-46cb-b63b-38a15848fa99 could not be found. May 19 12:31:01.387730 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': 'fd5e1226-df90-46cb-b63b-38a15848fa99'} May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5e1226-df90-46cb-b63b-38a15848fa99 could not be found. May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:31:01.391948 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:31:01.393559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:31:01.393559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:31:01.393559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:31:01.393559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:31:01.393559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:31:01.393559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:31:01.393559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:31:01.393559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5e1226-df90-46cb-b63b-38a15848fa99 could not be found. May 19 12:31:01.393559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:31:01.393559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:31:01.393559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:31:01.393559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:01.393559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:31:01.393559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:31:01.393559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:31:01.393559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:31:01.393559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5e1226-df90-46cb-b63b-38a15848fa99 could not be found. May 19 12:31:01.393559 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:31:01.395107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-461ffae6-c078-49ff-904f-ecdfcfa34ced tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Returning 404 to user: Instance fd5e1226-df90-46cb-b63b-38a15848fa99 could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:31:01.395107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-461ffae6-c078-49ff-904f-ecdfcfa34ced tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 404 len: 111 microversion: 2.1 time: 0.037421 May 19 12:31:01.395107 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 547/1143] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:01 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:31:01.593345 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ba5ec415-17ef-49b4-b795-057c290affc7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1118123297", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1269836910", "security_groups": [{"name": "tempest-secgroup-smoke-422211665"}], "block_device_mapping_v2": [{"uuid": "c49e05f7-2463-4c19-81d9-912aa05f0c5c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8cb239d8-0b94-495c-8855-e9aad30a1cb5"}]}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:01.787024 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-ba5ec415-17ef-49b4-b795-057c290affc7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] validate_networks() for [('8cb239d8-0b94-495c-8855-e9aad30a1cb5', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:31:02.448858 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-ba5ec415-17ef-49b4-b795-057c290affc7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:31:02.449441 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-ba5ec415-17ef-49b4-b795-057c290affc7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:31:02.450120 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-ba5ec415-17ef-49b4-b795-057c290affc7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:31:02.450635 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-ba5ec415-17ef-49b4-b795-057c290affc7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:31:02.451217 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-ba5ec415-17ef-49b4-b795-057c290affc7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:31:02.462175 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ba5ec415-17ef-49b4-b795-057c290affc7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:02.462527 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ba5ec415-17ef-49b4-b795-057c290affc7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:02.464138 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ba5ec415-17ef-49b4-b795-057c290affc7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:02.464574 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ba5ec415-17ef-49b4-b795-057c290affc7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:02.485131 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-ba5ec415-17ef-49b4-b795-057c290affc7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Getting quotas for project 4b46044a7f1d471582800c9d8a79e5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:31:02.490329 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-ba5ec415-17ef-49b4-b795-057c290affc7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Getting quotas for user 2d158b01a0a74de4bc0131b5c625efdf and project 4b46044a7f1d471582800c9d8a79e5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:31:02.562518 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ba5ec415-17ef-49b4-b795-057c290affc7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:31:02.565432 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ba5ec415-17ef-49b4-b795-057c290affc7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c49e05f7-2463-4c19-81d9-912aa05f0c5c',volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:31:03.107602 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ba5ec415-17ef-49b4-b795-057c290affc7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.521330 May 19 12:31:03.108335 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 597/1144] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:31:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:31:03.119311 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-1cea2f9b-9a24-480a-9d34-1bc5986515b1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:03.120234 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-1cea2f9b-9a24-480a-9d34-1bc5986515b1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:03.208375 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-1cea2f9b-9a24-480a-9d34-1bc5986515b1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:03.219503 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-1cea2f9b-9a24-480a-9d34-1bc5986515b1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1095 microversion: 2.1 time: 0.104439 May 19 12:31:03.225678 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 548/1145] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:03 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1095 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:04.247834 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-18ee8344-7de6-43f5-909f-bfeb999eda84 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:04.248438 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-18ee8344-7de6-43f5-909f-bfeb999eda84 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:04.314495 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-18ee8344-7de6-43f5-909f-bfeb999eda84 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:04.322209 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-18ee8344-7de6-43f5-909f-bfeb999eda84 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1095 microversion: 2.1 time: 0.079577 May 19 12:31:04.322847 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 598/1146] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:04 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:05.342951 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ac304aa4-f3b6-4077-a34f-92d4898508fc tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:05.344099 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ac304aa4-f3b6-4077-a34f-92d4898508fc tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:05.356840 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ac304aa4-f3b6-4077-a34f-92d4898508fc tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:05.357204 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ac304aa4-f3b6-4077-a34f-92d4898508fc tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:05.358014 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ac304aa4-f3b6-4077-a34f-92d4898508fc tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:05.358462 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ac304aa4-f3b6-4077-a34f-92d4898508fc tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:05.432659 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ac304aa4-f3b6-4077-a34f-92d4898508fc tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:05.445565 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ac304aa4-f3b6-4077-a34f-92d4898508fc tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1137 microversion: 2.1 time: 0.109506 May 19 12:31:05.446562 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 549/1147] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:05 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1137 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:06.476115 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-43dbed8c-5021-41db-a519-1640301f50bf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:06.478669 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-43dbed8c-5021-41db-a519-1640301f50bf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:06.491910 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-43dbed8c-5021-41db-a519-1640301f50bf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:06.494310 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-43dbed8c-5021-41db-a519-1640301f50bf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:06.498623 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-43dbed8c-5021-41db-a519-1640301f50bf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:06.499845 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-43dbed8c-5021-41db-a519-1640301f50bf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:06.615108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-43dbed8c-5021-41db-a519-1640301f50bf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:06.625532 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-43dbed8c-5021-41db-a519-1640301f50bf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1201 microversion: 2.1 time: 0.157163 May 19 12:31:06.626307 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 599/1148] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:06 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1201 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:07.658152 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-76c6af88-6e61-4636-a628-521c5d4687d8 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:07.658797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-76c6af88-6e61-4636-a628-521c5d4687d8 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:07.667972 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-76c6af88-6e61-4636-a628-521c5d4687d8 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:07.668759 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-76c6af88-6e61-4636-a628-521c5d4687d8 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:07.670215 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-76c6af88-6e61-4636-a628-521c5d4687d8 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:07.671026 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-76c6af88-6e61-4636-a628-521c5d4687d8 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:07.913596 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-76c6af88-6e61-4636-a628-521c5d4687d8 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:07.928561 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-76c6af88-6e61-4636-a628-521c5d4687d8 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1278 microversion: 2.1 time: 0.273458 May 19 12:31:07.930713 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 550/1149] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:07 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1278 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:08.955110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-89dd8e9f-e66e-4c61-abcd-9cfd6cb7ee29 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:08.959338 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-89dd8e9f-e66e-4c61-abcd-9cfd6cb7ee29 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:08.974460 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-89dd8e9f-e66e-4c61-abcd-9cfd6cb7ee29 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:08.975671 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-89dd8e9f-e66e-4c61-abcd-9cfd6cb7ee29 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:08.979106 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-89dd8e9f-e66e-4c61-abcd-9cfd6cb7ee29 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:08.980404 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-89dd8e9f-e66e-4c61-abcd-9cfd6cb7ee29 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:09.208067 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-36de8524-458b-4d60-9371-9280dcfeffe1 req-49e4fec4-6a85-481e-b3fe-b29dabb3dd11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ff53b5f-8422-468d-8c6c-48b571af4ab2", "tag": "77188d20-c02a-4816-acef-33d2b5800ec2"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:09.208067 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-36de8524-458b-4d60-9371-9280dcfeffe1 req-49e4fec4-6a85-481e-b3fe-b29dabb3dd11 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:09.208067 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-36de8524-458b-4d60-9371-9280dcfeffe1 req-49e4fec4-6a85-481e-b3fe-b29dabb3dd11 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:09.208067 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-36de8524-458b-4d60-9371-9280dcfeffe1 req-49e4fec4-6a85-481e-b3fe-b29dabb3dd11 service nova] Creating event network-changed:77188d20-c02a-4816-acef-33d2b5800ec2 for instance 9ff53b5f-8422-468d-8c6c-48b571af4ab2 on hv-cinder-80475 May 19 12:31:09.211637 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-36de8524-458b-4d60-9371-9280dcfeffe1 req-49e4fec4-6a85-481e-b3fe-b29dabb3dd11 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065458 May 19 12:31:09.211637 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 551/1150] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:31:09.211637 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-de61d439-02ea-472d-903a-0cece1873ed6 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1135509920", "imageRef": "962252c6-9c2c-4b81-bdb7-f6d317bada3b", "flavorRef": "452"}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:09.221863 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.network.neutron [None req-de61d439-02ea-472d-903a-0cece1873ed6 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] validate_networks() for None {{(pid=117964) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:31:09.551409 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-89dd8e9f-e66e-4c61-abcd-9cfd6cb7ee29 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:09.569085 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-89dd8e9f-e66e-4c61-abcd-9cfd6cb7ee29 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1278 microversion: 2.1 time: 0.620535 May 19 12:31:09.570154 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 600/1151] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:08 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1278 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:09.690688 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-de61d439-02ea-472d-903a-0cece1873ed6 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Flavor limits 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:31:09.691143 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-de61d439-02ea-472d-903a-0cece1873ed6 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Image limits 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:31:09.691639 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-de61d439-02ea-472d-903a-0cece1873ed6 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Flavor pref 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:31:09.692103 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-de61d439-02ea-472d-903a-0cece1873ed6 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Image pref 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:31:09.692562 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-de61d439-02ea-472d-903a-0cece1873ed6 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:31:09.703076 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-de61d439-02ea-472d-903a-0cece1873ed6 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:09.703533 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-de61d439-02ea-472d-903a-0cece1873ed6 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:09.704463 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-de61d439-02ea-472d-903a-0cece1873ed6 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:09.704957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-de61d439-02ea-472d-903a-0cece1873ed6 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:09.724459 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-de61d439-02ea-472d-903a-0cece1873ed6 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Getting quotas for project 03c8ec22ac914f63a81e67c98d018815. Resources: {'instances', 'ram', 'cores'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:31:09.729826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-de61d439-02ea-472d-903a-0cece1873ed6 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Getting quotas for user d9922026c1784ed4bd40bbb5c139cf04 and project 03c8ec22ac914f63a81e67c98d018815. Resources: {'instances', 'ram', 'cores'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:31:09.743388 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-de61d439-02ea-472d-903a-0cece1873ed6 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Going to run 1 instances... {{(pid=117964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:31:09.746157 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-de61d439-02ea-472d-903a-0cece1873ed6 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962252c6-9c2c-4b81-bdb7-f6d317bada3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:31:09.867830 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR oslo.messaging._drivers.impl_rabbit [None req-de61d439-02ea-472d-903a-0cece1873ed6 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [971ced82-19a1-416d-937c-2699c53c159c] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 12:31:10.586818 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-53808257-5304-4b09-828a-bc3a32b74f7a tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:10.587505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-53808257-5304-4b09-828a-bc3a32b74f7a tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:10.595153 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-53808257-5304-4b09-828a-bc3a32b74f7a tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:10.595614 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-53808257-5304-4b09-828a-bc3a32b74f7a tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:10.596607 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-53808257-5304-4b09-828a-bc3a32b74f7a tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:10.597057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-53808257-5304-4b09-828a-bc3a32b74f7a tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:10.783108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-53808257-5304-4b09-828a-bc3a32b74f7a tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:10.792724 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-53808257-5304-4b09-828a-bc3a32b74f7a tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1278 microversion: 2.1 time: 0.209613 May 19 12:31:10.793320 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 601/1152] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:10 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1278 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:10.876700 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO oslo.messaging._drivers.impl_rabbit [None req-de61d439-02ea-472d-903a-0cece1873ed6 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [971ced82-19a1-416d-937c-2699c53c159c] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 56714. May 19 12:31:10.881650 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-de61d439-02ea-472d-903a-0cece1873ed6 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.757917 May 19 12:31:10.882478 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 552/1153] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:31:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:31:10.894925 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ba2be2fe-f67e-4d0f-a4ad-e690d6af9165 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:10.895832 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ba2be2fe-f67e-4d0f-a4ad-e690d6af9165 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:10.957081 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ba2be2fe-f67e-4d0f-a4ad-e690d6af9165 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:10.965201 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ba2be2fe-f67e-4d0f-a4ad-e690d6af9165 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1215 microversion: 2.1 time: 0.074361 May 19 12:31:10.965990 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 602/1154] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:10 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:11.811980 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-182fbeed-e916-4f9a-bca7-b7f509fcb7e1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:11.813150 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-182fbeed-e916-4f9a-bca7-b7f509fcb7e1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:11.816768 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:11.827320 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-182fbeed-e916-4f9a-bca7-b7f509fcb7e1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:11.829600 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-182fbeed-e916-4f9a-bca7-b7f509fcb7e1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:11.829600 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-182fbeed-e916-4f9a-bca7-b7f509fcb7e1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:11.829600 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-182fbeed-e916-4f9a-bca7-b7f509fcb7e1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:11.985062 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2cdd834a-97a7-4d96-873f-3b728eab7471 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:11.985951 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2cdd834a-97a7-4d96-873f-3b728eab7471 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:12.045600 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-182fbeed-e916-4f9a-bca7-b7f509fcb7e1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:12.060784 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2cdd834a-97a7-4d96-873f-3b728eab7471 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:12.061215 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-182fbeed-e916-4f9a-bca7-b7f509fcb7e1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1266 microversion: 2.1 time: 0.255622 May 19 12:31:12.061842 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 553/1155] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:11 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:12.069513 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2cdd834a-97a7-4d96-873f-3b728eab7471 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1215 microversion: 2.1 time: 0.089252 May 19 12:31:12.070112 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 603/1156] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:11 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:13.089974 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-4962715e-34f5-4bd2-92be-b40f683bd5fe tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:13.090771 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-4962715e-34f5-4bd2-92be-b40f683bd5fe tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:13.097282 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-382e932d-fe28-4b3c-acb4-2cecaba5c841 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:13.100252 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-382e932d-fe28-4b3c-acb4-2cecaba5c841 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:13.102912 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:13.104055 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4962715e-34f5-4bd2-92be-b40f683bd5fe tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:13.105146 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4962715e-34f5-4bd2-92be-b40f683bd5fe tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:13.106344 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4962715e-34f5-4bd2-92be-b40f683bd5fe tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:13.107472 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-4962715e-34f5-4bd2-92be-b40f683bd5fe tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:13.193463 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-382e932d-fe28-4b3c-acb4-2cecaba5c841 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:13.208928 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-382e932d-fe28-4b3c-acb4-2cecaba5c841 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1215 microversion: 2.1 time: 0.119142 May 19 12:31:13.208928 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 604/1157] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:13 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1215 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:13.300914 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-4962715e-34f5-4bd2-92be-b40f683bd5fe tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:13.309061 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-4962715e-34f5-4bd2-92be-b40f683bd5fe tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1266 microversion: 2.1 time: 0.230450 May 19 12:31:13.312219 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 554/1158] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:13 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:14.223230 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2a68a8fc-8726-4794-b47a-b850dac1266a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:14.224087 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2a68a8fc-8726-4794-b47a-b850dac1266a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:14.291995 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2a68a8fc-8726-4794-b47a-b850dac1266a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:14.299553 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2a68a8fc-8726-4794-b47a-b850dac1266a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1215 microversion: 2.1 time: 0.080400 May 19 12:31:14.300183 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 605/1159] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:14 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:14.328938 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c7b48a04-f68e-4a85-b56e-c51af25afd8b tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:14.328938 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c7b48a04-f68e-4a85-b56e-c51af25afd8b tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:14.336168 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c7b48a04-f68e-4a85-b56e-c51af25afd8b tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:14.336618 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c7b48a04-f68e-4a85-b56e-c51af25afd8b tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:14.337408 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c7b48a04-f68e-4a85-b56e-c51af25afd8b tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:14.338007 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c7b48a04-f68e-4a85-b56e-c51af25afd8b tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:14.526467 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c7b48a04-f68e-4a85-b56e-c51af25afd8b tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:14.537020 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c7b48a04-f68e-4a85-b56e-c51af25afd8b tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1266 microversion: 2.1 time: 0.213948 May 19 12:31:14.537627 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 555/1160] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:14 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:15.319409 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f840f3fa-feee-49cb-aa10-1dae6c2dc881 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:15.320549 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f840f3fa-feee-49cb-aa10-1dae6c2dc881 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:15.409186 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f840f3fa-feee-49cb-aa10-1dae6c2dc881 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:15.421501 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f840f3fa-feee-49cb-aa10-1dae6c2dc881 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1215 microversion: 2.1 time: 0.106725 May 19 12:31:15.422549 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 606/1161] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:15 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:15.555717 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-fe5d62b1-affc-45a5-b5ae-5139a1d4a174 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:15.558711 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-fe5d62b1-affc-45a5-b5ae-5139a1d4a174 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:15.569004 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fe5d62b1-affc-45a5-b5ae-5139a1d4a174 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:15.569726 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fe5d62b1-affc-45a5-b5ae-5139a1d4a174 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:15.570603 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fe5d62b1-affc-45a5-b5ae-5139a1d4a174 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:15.571023 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fe5d62b1-affc-45a5-b5ae-5139a1d4a174 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:15.579548 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=85 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:15.821941 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-fe5d62b1-affc-45a5-b5ae-5139a1d4a174 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:15.830491 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-fe5d62b1-affc-45a5-b5ae-5139a1d4a174 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1266 microversion: 2.1 time: 0.279350 May 19 12:31:15.831371 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 556/1162] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:15 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:16.446977 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-93ef7be5-1b3f-49ae-9e91-6dbcc7433aa1 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:16.447813 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-93ef7be5-1b3f-49ae-9e91-6dbcc7433aa1 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:16.449996 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:16.455851 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-93ef7be5-1b3f-49ae-9e91-6dbcc7433aa1 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:16.456314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-93ef7be5-1b3f-49ae-9e91-6dbcc7433aa1 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:16.457107 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-93ef7be5-1b3f-49ae-9e91-6dbcc7433aa1 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:16.457545 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-93ef7be5-1b3f-49ae-9e91-6dbcc7433aa1 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:16.462325 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:16.527437 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-93ef7be5-1b3f-49ae-9e91-6dbcc7433aa1 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:16.535748 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-93ef7be5-1b3f-49ae-9e91-6dbcc7433aa1 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1219 microversion: 2.1 time: 0.093005 May 19 12:31:16.536693 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 607/1163] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:16 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:16.848542 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-2d14652f-7c16-4ed7-bd0f-6e9607bbfed7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:16.853697 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-2d14652f-7c16-4ed7-bd0f-6e9607bbfed7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:16.860669 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2d14652f-7c16-4ed7-bd0f-6e9607bbfed7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:16.869261 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2d14652f-7c16-4ed7-bd0f-6e9607bbfed7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:16.869261 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2d14652f-7c16-4ed7-bd0f-6e9607bbfed7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:16.869261 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2d14652f-7c16-4ed7-bd0f-6e9607bbfed7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:17.086664 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-2d14652f-7c16-4ed7-bd0f-6e9607bbfed7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:17.086664 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-2d14652f-7c16-4ed7-bd0f-6e9607bbfed7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1266 microversion: 2.1 time: 0.186939 May 19 12:31:17.086664 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 557/1164] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:16 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:17.560793 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-54127705-b1d0-4878-b9a6-6255e2658386 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:17.560793 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-54127705-b1d0-4878-b9a6-6255e2658386 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:17.567612 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-54127705-b1d0-4878-b9a6-6255e2658386 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:17.568092 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-54127705-b1d0-4878-b9a6-6255e2658386 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:17.568877 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-54127705-b1d0-4878-b9a6-6255e2658386 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:17.569303 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-54127705-b1d0-4878-b9a6-6255e2658386 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:17.655760 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-54127705-b1d0-4878-b9a6-6255e2658386 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:17.684291 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-54127705-b1d0-4878-b9a6-6255e2658386 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1267 microversion: 2.1 time: 0.133578 May 19 12:31:17.684965 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 608/1165] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:17 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1267 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:18.099173 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-57305846-857c-46ac-8b27-a87b162bf631 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:18.100098 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-57305846-857c-46ac-8b27-a87b162bf631 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:18.109340 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-57305846-857c-46ac-8b27-a87b162bf631 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:18.109883 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-57305846-857c-46ac-8b27-a87b162bf631 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:18.110911 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-57305846-857c-46ac-8b27-a87b162bf631 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:18.111428 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-57305846-857c-46ac-8b27-a87b162bf631 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:18.384759 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-57305846-857c-46ac-8b27-a87b162bf631 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:18.409223 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-57305846-857c-46ac-8b27-a87b162bf631 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1266 microversion: 2.1 time: 0.304712 May 19 12:31:18.409223 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 558/1166] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:18 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:18.705861 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4f6e417f-a8e5-4fd2-9010-9a6b68802277 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:18.706859 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4f6e417f-a8e5-4fd2-9010-9a6b68802277 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:18.715733 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4f6e417f-a8e5-4fd2-9010-9a6b68802277 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:18.716301 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4f6e417f-a8e5-4fd2-9010-9a6b68802277 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:18.717246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4f6e417f-a8e5-4fd2-9010-9a6b68802277 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:18.717746 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4f6e417f-a8e5-4fd2-9010-9a6b68802277 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:18.794602 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4f6e417f-a8e5-4fd2-9010-9a6b68802277 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:18.807179 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4f6e417f-a8e5-4fd2-9010-9a6b68802277 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1273 microversion: 2.1 time: 0.105505 May 19 12:31:18.808347 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 609/1167] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:18 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1273 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:19.417945 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6508029c-3912-47c4-a3d1-49f0c12c7bd7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:19.418789 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6508029c-3912-47c4-a3d1-49f0c12c7bd7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:19.426063 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6508029c-3912-47c4-a3d1-49f0c12c7bd7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:19.426875 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6508029c-3912-47c4-a3d1-49f0c12c7bd7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:19.427926 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6508029c-3912-47c4-a3d1-49f0c12c7bd7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:19.428369 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6508029c-3912-47c4-a3d1-49f0c12c7bd7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:19.642575 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6508029c-3912-47c4-a3d1-49f0c12c7bd7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:19.652530 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6508029c-3912-47c4-a3d1-49f0c12c7bd7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1266 microversion: 2.1 time: 0.239454 May 19 12:31:19.662209 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 559/1168] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:19 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:19.828843 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8acb0b9a-70d6-412f-89e4-afddc8d0bca5 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:19.829470 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8acb0b9a-70d6-412f-89e4-afddc8d0bca5 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:19.836188 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8acb0b9a-70d6-412f-89e4-afddc8d0bca5 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:19.836656 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8acb0b9a-70d6-412f-89e4-afddc8d0bca5 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:19.837570 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8acb0b9a-70d6-412f-89e4-afddc8d0bca5 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:19.838510 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8acb0b9a-70d6-412f-89e4-afddc8d0bca5 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:20.051428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8acb0b9a-70d6-412f-89e4-afddc8d0bca5 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:20.061369 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8acb0b9a-70d6-412f-89e4-afddc8d0bca5 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1315 microversion: 2.1 time: 0.237879 May 19 12:31:20.061964 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 610/1169] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:19 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:20.678053 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-1a3ab955-e73d-411e-abd8-1a0a9a397cd9 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:20.680190 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-1a3ab955-e73d-411e-abd8-1a0a9a397cd9 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:20.688239 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=2 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:20.690202 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=8 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:20.700706 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1a3ab955-e73d-411e-abd8-1a0a9a397cd9 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:20.704314 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1a3ab955-e73d-411e-abd8-1a0a9a397cd9 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:20.704314 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1a3ab955-e73d-411e-abd8-1a0a9a397cd9 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:20.705714 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-1a3ab955-e73d-411e-abd8-1a0a9a397cd9 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:20.909661 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-1a3ab955-e73d-411e-abd8-1a0a9a397cd9 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:20.920034 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-1a3ab955-e73d-411e-abd8-1a0a9a397cd9 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1266 microversion: 2.1 time: 0.250352 May 19 12:31:20.921295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 560/1170] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:20 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:21.083722 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9c3cfeb7-326e-44ae-8140-a0c6b5993fee tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:21.092401 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9c3cfeb7-326e-44ae-8140-a0c6b5993fee tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:21.107270 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9c3cfeb7-326e-44ae-8140-a0c6b5993fee tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:21.108852 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9c3cfeb7-326e-44ae-8140-a0c6b5993fee tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:21.113745 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9c3cfeb7-326e-44ae-8140-a0c6b5993fee tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:21.115172 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9c3cfeb7-326e-44ae-8140-a0c6b5993fee tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:21.317023 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9c3cfeb7-326e-44ae-8140-a0c6b5993fee tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:21.335323 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9c3cfeb7-326e-44ae-8140-a0c6b5993fee tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1315 microversion: 2.1 time: 0.257269 May 19 12:31:21.338443 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 611/1171] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:21 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:21.483141 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-37f1c88e-508f-42b6-8787-9a6b3d77c369 req-3faf8d81-8986-47ec-bd53-65dcca48351c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48b69386-ba6a-4cd5-9ae8-7c693f14b14b", "tag": "1fa1eac4-ae34-4463-ba02-c082a24c8e47"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:21.498482 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-37f1c88e-508f-42b6-8787-9a6b3d77c369 req-3faf8d81-8986-47ec-bd53-65dcca48351c service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:21.498482 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-37f1c88e-508f-42b6-8787-9a6b3d77c369 req-3faf8d81-8986-47ec-bd53-65dcca48351c service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:21.519662 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-37f1c88e-508f-42b6-8787-9a6b3d77c369 req-3faf8d81-8986-47ec-bd53-65dcca48351c service nova] Creating event network-changed:1fa1eac4-ae34-4463-ba02-c082a24c8e47 for instance 48b69386-ba6a-4cd5-9ae8-7c693f14b14b on hv-cinder-80475 May 19 12:31:21.529011 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-37f1c88e-508f-42b6-8787-9a6b3d77c369 req-3faf8d81-8986-47ec-bd53-65dcca48351c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050071 May 19 12:31:21.532102 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 561/1172] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:31:21.949865 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f46f651a-bb8e-4818-8829-42199e9c55bf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:21.950853 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f46f651a-bb8e-4818-8829-42199e9c55bf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:21.960750 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f46f651a-bb8e-4818-8829-42199e9c55bf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:21.961873 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f46f651a-bb8e-4818-8829-42199e9c55bf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:21.965672 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f46f651a-bb8e-4818-8829-42199e9c55bf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:21.965672 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f46f651a-bb8e-4818-8829-42199e9c55bf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:22.257536 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f46f651a-bb8e-4818-8829-42199e9c55bf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:22.274148 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f46f651a-bb8e-4818-8829-42199e9c55bf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1266 microversion: 2.1 time: 0.334414 May 19 12:31:22.276772 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 612/1173] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:21 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:22.355489 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c327f9f4-fdcf-40a4-9fbb-d564bb56c6bd tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:22.360744 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c327f9f4-fdcf-40a4-9fbb-d564bb56c6bd tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:22.367761 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c327f9f4-fdcf-40a4-9fbb-d564bb56c6bd tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:22.370338 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c327f9f4-fdcf-40a4-9fbb-d564bb56c6bd tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:22.370338 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c327f9f4-fdcf-40a4-9fbb-d564bb56c6bd tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:22.370338 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c327f9f4-fdcf-40a4-9fbb-d564bb56c6bd tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:22.545881 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-2eb90e9c-3810-4f84-aa15-0b8588aa4b0b req-dfcff9f5-7ff7-4851-ab9f-dc8e44a275dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ff53b5f-8422-468d-8c6c-48b571af4ab2", "name": "network-vif-plugged", "status": "completed", "tag": "77188d20-c02a-4816-acef-33d2b5800ec2"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:22.558301 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-2eb90e9c-3810-4f84-aa15-0b8588aa4b0b req-dfcff9f5-7ff7-4851-ab9f-dc8e44a275dd service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:22.558852 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-2eb90e9c-3810-4f84-aa15-0b8588aa4b0b req-dfcff9f5-7ff7-4851-ab9f-dc8e44a275dd service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:22.577203 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-2eb90e9c-3810-4f84-aa15-0b8588aa4b0b req-dfcff9f5-7ff7-4851-ab9f-dc8e44a275dd service nova] Creating event network-vif-plugged:77188d20-c02a-4816-acef-33d2b5800ec2 for instance 9ff53b5f-8422-468d-8c6c-48b571af4ab2 on hv-cinder-80475 May 19 12:31:22.577691 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c327f9f4-fdcf-40a4-9fbb-d564bb56c6bd tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:22.585801 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-2eb90e9c-3810-4f84-aa15-0b8588aa4b0b req-dfcff9f5-7ff7-4851-ab9f-dc8e44a275dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045943 May 19 12:31:22.586631 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 613/1174] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:31:22.594409 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c327f9f4-fdcf-40a4-9fbb-d564bb56c6bd tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1315 microversion: 2.1 time: 0.244144 May 19 12:31:22.595470 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 562/1175] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:22 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:23.295435 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bf2cac36-76a2-442a-8032-a6362df4c8af tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:23.296235 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bf2cac36-76a2-442a-8032-a6362df4c8af tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:23.303982 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bf2cac36-76a2-442a-8032-a6362df4c8af tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:23.304471 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bf2cac36-76a2-442a-8032-a6362df4c8af tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:23.305273 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bf2cac36-76a2-442a-8032-a6362df4c8af tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:23.305842 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bf2cac36-76a2-442a-8032-a6362df4c8af tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:23.471618 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bf2cac36-76a2-442a-8032-a6362df4c8af tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:23.483588 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bf2cac36-76a2-442a-8032-a6362df4c8af tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1266 microversion: 2.1 time: 0.192971 May 19 12:31:23.484340 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 614/1176] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:23 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:23.624340 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-357d12e6-1124-4a23-812c-a28e51c82414 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:23.625927 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-357d12e6-1124-4a23-812c-a28e51c82414 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:23.633813 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-357d12e6-1124-4a23-812c-a28e51c82414 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:23.634414 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-357d12e6-1124-4a23-812c-a28e51c82414 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:23.635421 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-357d12e6-1124-4a23-812c-a28e51c82414 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:23.635817 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-357d12e6-1124-4a23-812c-a28e51c82414 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:23.793068 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-357d12e6-1124-4a23-812c-a28e51c82414 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:23.803511 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-357d12e6-1124-4a23-812c-a28e51c82414 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1315 microversion: 2.1 time: 0.184561 May 19 12:31:23.804374 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 563/1177] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:23 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:24.507646 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3b7b1d84-ae87-4a1e-bb3a-f6862dbb89a0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:24.508597 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3b7b1d84-ae87-4a1e-bb3a-f6862dbb89a0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:24.518772 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3b7b1d84-ae87-4a1e-bb3a-f6862dbb89a0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:24.520062 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3b7b1d84-ae87-4a1e-bb3a-f6862dbb89a0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:24.520521 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3b7b1d84-ae87-4a1e-bb3a-f6862dbb89a0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:24.521051 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3b7b1d84-ae87-4a1e-bb3a-f6862dbb89a0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:24.741964 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3b7b1d84-ae87-4a1e-bb3a-f6862dbb89a0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:24.751967 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3b7b1d84-ae87-4a1e-bb3a-f6862dbb89a0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1266 microversion: 2.1 time: 0.249186 May 19 12:31:24.752938 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 615/1178] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:24 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:24.825115 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-c0fde118-71fb-408a-a039-391e83a711bc tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:24.825878 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-c0fde118-71fb-408a-a039-391e83a711bc tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:24.833087 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c0fde118-71fb-408a-a039-391e83a711bc tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:24.833571 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c0fde118-71fb-408a-a039-391e83a711bc tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:24.834375 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c0fde118-71fb-408a-a039-391e83a711bc tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:24.834838 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-c0fde118-71fb-408a-a039-391e83a711bc tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:25.092557 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-c0fde118-71fb-408a-a039-391e83a711bc tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:25.101513 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-c0fde118-71fb-408a-a039-391e83a711bc tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1315 microversion: 2.1 time: 0.282038 May 19 12:31:25.102114 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 564/1179] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:24 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:25.778436 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-80376234-2f09-4f16-b410-b5a2c3bc095c tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:25.779205 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-80376234-2f09-4f16-b410-b5a2c3bc095c tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:25.781212 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=18 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:25.787247 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-80376234-2f09-4f16-b410-b5a2c3bc095c tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:25.787712 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-80376234-2f09-4f16-b410-b5a2c3bc095c tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:25.788608 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-80376234-2f09-4f16-b410-b5a2c3bc095c tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:25.789056 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-80376234-2f09-4f16-b410-b5a2c3bc095c tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:25.961031 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-80376234-2f09-4f16-b410-b5a2c3bc095c tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:25.970141 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-80376234-2f09-4f16-b410-b5a2c3bc095c tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1266 microversion: 2.1 time: 0.196470 May 19 12:31:25.970843 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 616/1180] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:25 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:26.122253 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-304f7495-17b8-4de9-8fea-7f606e3175d2 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:26.123434 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-304f7495-17b8-4de9-8fea-7f606e3175d2 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:26.131702 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-304f7495-17b8-4de9-8fea-7f606e3175d2 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:26.132395 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-304f7495-17b8-4de9-8fea-7f606e3175d2 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:26.133534 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-304f7495-17b8-4de9-8fea-7f606e3175d2 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:26.134167 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-304f7495-17b8-4de9-8fea-7f606e3175d2 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:26.314389 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-304f7495-17b8-4de9-8fea-7f606e3175d2 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:26.328867 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-304f7495-17b8-4de9-8fea-7f606e3175d2 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1315 microversion: 2.1 time: 0.211683 May 19 12:31:26.329887 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 565/1181] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:26 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:27.000872 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-411c1938-4fc6-4f07-8bd0-de5e24e24a42 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:27.001923 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-411c1938-4fc6-4f07-8bd0-de5e24e24a42 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:27.014086 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-411c1938-4fc6-4f07-8bd0-de5e24e24a42 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:27.015370 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-411c1938-4fc6-4f07-8bd0-de5e24e24a42 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:27.016347 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-411c1938-4fc6-4f07-8bd0-de5e24e24a42 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:27.016997 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-411c1938-4fc6-4f07-8bd0-de5e24e24a42 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:27.215308 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-411c1938-4fc6-4f07-8bd0-de5e24e24a42 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:27.224468 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-411c1938-4fc6-4f07-8bd0-de5e24e24a42 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1453 microversion: 2.1 time: 0.232765 May 19 12:31:27.225075 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 617/1182] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:26 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1453 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:27.248253 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6cd8202b-dc3a-4373-a1e2-c27dfc6cdbce tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:27.248876 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6cd8202b-dc3a-4373-a1e2-c27dfc6cdbce tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:27.257032 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6cd8202b-dc3a-4373-a1e2-c27dfc6cdbce tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:27.257360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6cd8202b-dc3a-4373-a1e2-c27dfc6cdbce tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:27.258195 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6cd8202b-dc3a-4373-a1e2-c27dfc6cdbce tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:27.258634 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6cd8202b-dc3a-4373-a1e2-c27dfc6cdbce tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:27.359011 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7e8a28c7-24bc-48e9-b226-29ab3b4b79fd tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:27.366106 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7e8a28c7-24bc-48e9-b226-29ab3b4b79fd tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:27.376233 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7e8a28c7-24bc-48e9-b226-29ab3b4b79fd tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:27.377097 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7e8a28c7-24bc-48e9-b226-29ab3b4b79fd tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:27.378163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7e8a28c7-24bc-48e9-b226-29ab3b4b79fd tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:27.379486 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7e8a28c7-24bc-48e9-b226-29ab3b4b79fd tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:27.657205 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6cd8202b-dc3a-4373-a1e2-c27dfc6cdbce tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:27.698159 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6cd8202b-dc3a-4373-a1e2-c27dfc6cdbce tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1453 microversion: 2.1 time: 0.448666 May 19 12:31:27.700025 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 566/1183] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:27 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1453 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:27.732090 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7e8a28c7-24bc-48e9-b226-29ab3b4b79fd tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:27.741941 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7e8a28c7-24bc-48e9-b226-29ab3b4b79fd tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1315 microversion: 2.1 time: 0.396487 May 19 12:31:27.752693 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 618/1184] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:27 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:28.319740 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-6e7fe91e-8254-4552-aeb5-d738d5a9efa0 req-4f9fab26-d83a-4d44-b89f-6c3e05ab0f22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b69386-ba6a-4cd5-9ae8-7c693f14b14b", "name": "network-vif-plugged", "status": "completed", "tag": "1fa1eac4-ae34-4463-ba02-c082a24c8e47"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:28.331833 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-6e7fe91e-8254-4552-aeb5-d738d5a9efa0 req-4f9fab26-d83a-4d44-b89f-6c3e05ab0f22 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:28.332333 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-6e7fe91e-8254-4552-aeb5-d738d5a9efa0 req-4f9fab26-d83a-4d44-b89f-6c3e05ab0f22 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:28.344998 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-6e7fe91e-8254-4552-aeb5-d738d5a9efa0 req-4f9fab26-d83a-4d44-b89f-6c3e05ab0f22 service nova] Creating event network-vif-plugged:1fa1eac4-ae34-4463-ba02-c082a24c8e47 for instance 48b69386-ba6a-4cd5-9ae8-7c693f14b14b on hv-cinder-80475 May 19 12:31:28.350305 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-6e7fe91e-8254-4552-aeb5-d738d5a9efa0 req-4f9fab26-d83a-4d44-b89f-6c3e05ab0f22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035913 May 19 12:31:28.354518 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 567/1185] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:31:28.762437 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-82a21d45-2167-4218-9f20-a6ea5211edfe tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:28.763619 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-82a21d45-2167-4218-9f20-a6ea5211edfe tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:28.776155 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-82a21d45-2167-4218-9f20-a6ea5211edfe tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:28.777332 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-82a21d45-2167-4218-9f20-a6ea5211edfe tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:28.780940 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-82a21d45-2167-4218-9f20-a6ea5211edfe tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:28.780940 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-82a21d45-2167-4218-9f20-a6ea5211edfe tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:29.024224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-82a21d45-2167-4218-9f20-a6ea5211edfe tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:29.035334 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-82a21d45-2167-4218-9f20-a6ea5211edfe tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1315 microversion: 2.1 time: 0.280032 May 19 12:31:29.036700 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 619/1186] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:28 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:30.061268 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-e9d04d8b-8dd7-45d7-ae84-1d59053b24d9 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:30.062721 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-e9d04d8b-8dd7-45d7-ae84-1d59053b24d9 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:30.073514 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e9d04d8b-8dd7-45d7-ae84-1d59053b24d9 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:30.073975 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e9d04d8b-8dd7-45d7-ae84-1d59053b24d9 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:30.074797 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e9d04d8b-8dd7-45d7-ae84-1d59053b24d9 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:30.075243 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-e9d04d8b-8dd7-45d7-ae84-1d59053b24d9 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:30.241221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-e9d04d8b-8dd7-45d7-ae84-1d59053b24d9 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:30.252491 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-e9d04d8b-8dd7-45d7-ae84-1d59053b24d9 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1315 microversion: 2.1 time: 0.201562 May 19 12:31:30.253084 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 568/1187] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:30 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:30.386466 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-c1808602-c052-415b-899f-73eba0cd647a req-5cb8ab7f-a2b8-46b1-8ecd-c054e46ee96a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ff53b5f-8422-468d-8c6c-48b571af4ab2", "tag": "77188d20-c02a-4816-acef-33d2b5800ec2"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:30.396462 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-c1808602-c052-415b-899f-73eba0cd647a req-5cb8ab7f-a2b8-46b1-8ecd-c054e46ee96a service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:30.396904 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-c1808602-c052-415b-899f-73eba0cd647a req-5cb8ab7f-a2b8-46b1-8ecd-c054e46ee96a service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:30.409697 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-c1808602-c052-415b-899f-73eba0cd647a req-5cb8ab7f-a2b8-46b1-8ecd-c054e46ee96a service nova] Creating event network-changed:77188d20-c02a-4816-acef-33d2b5800ec2 for instance 9ff53b5f-8422-468d-8c6c-48b571af4ab2 on hv-cinder-80475 May 19 12:31:30.415666 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-c1808602-c052-415b-899f-73eba0cd647a req-5cb8ab7f-a2b8-46b1-8ecd-c054e46ee96a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033965 May 19 12:31:30.416271 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 620/1188] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:31:31.279161 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-2ad25b82-afc6-4c0a-b496-b02c594f5cca tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:31.280506 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-2ad25b82-afc6-4c0a-b496-b02c594f5cca tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:31.287666 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2ad25b82-afc6-4c0a-b496-b02c594f5cca tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:31.288210 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2ad25b82-afc6-4c0a-b496-b02c594f5cca tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:31.289246 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2ad25b82-afc6-4c0a-b496-b02c594f5cca tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:31.289684 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2ad25b82-afc6-4c0a-b496-b02c594f5cca tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:31.490930 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-2ad25b82-afc6-4c0a-b496-b02c594f5cca tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:31.505909 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-2ad25b82-afc6-4c0a-b496-b02c594f5cca tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1465 microversion: 2.1 time: 0.231540 May 19 12:31:31.508301 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 569/1189] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:31 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1465 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:31.554272 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4ee2115d-36e8-49f8-8990-a435bb57a6ec tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:31.555584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4ee2115d-36e8-49f8-8990-a435bb57a6ec tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:31.564977 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4ee2115d-36e8-49f8-8990-a435bb57a6ec tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:31.565745 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4ee2115d-36e8-49f8-8990-a435bb57a6ec tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:31.566832 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4ee2115d-36e8-49f8-8990-a435bb57a6ec tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:31.567434 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4ee2115d-36e8-49f8-8990-a435bb57a6ec tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:31.604959 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4ee2115d-36e8-49f8-8990-a435bb57a6ec tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:31:32.086514 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4ee2115d-36e8-49f8-8990-a435bb57a6ec tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "DELETE /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 204 len: 0 microversion: 2.1 time: 0.536683 May 19 12:31:32.088279 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 621/1190] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:31:31 2022] DELETE /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:31:32.100652 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-73b14c51-08fe-4b47-a812-06ac3f6fe2d5 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:32.101361 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-73b14c51-08fe-4b47-a812-06ac3f6fe2d5 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:32.111575 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-73b14c51-08fe-4b47-a812-06ac3f6fe2d5 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:32.112354 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-73b14c51-08fe-4b47-a812-06ac3f6fe2d5 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:32.113736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-73b14c51-08fe-4b47-a812-06ac3f6fe2d5 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:32.114242 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-73b14c51-08fe-4b47-a812-06ac3f6fe2d5 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:32.278116 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-73b14c51-08fe-4b47-a812-06ac3f6fe2d5 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:32.286363 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-73b14c51-08fe-4b47-a812-06ac3f6fe2d5 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1471 microversion: 2.1 time: 0.191939 May 19 12:31:32.287056 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 570/1191] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:32 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1471 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:33.313481 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-98d85eff-a950-408b-9ab9-beccf015ffa2 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:33.314549 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-98d85eff-a950-408b-9ab9-beccf015ffa2 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:33.321582 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98d85eff-a950-408b-9ab9-beccf015ffa2 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:33.322612 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98d85eff-a950-408b-9ab9-beccf015ffa2 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:33.323586 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98d85eff-a950-408b-9ab9-beccf015ffa2 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:33.324063 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98d85eff-a950-408b-9ab9-beccf015ffa2 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:33.470425 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-98d85eff-a950-408b-9ab9-beccf015ffa2 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:33.480223 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-98d85eff-a950-408b-9ab9-beccf015ffa2 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1471 microversion: 2.1 time: 0.170937 May 19 12:31:33.480814 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 622/1192] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:33 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:34.503254 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-7fa212e0-97d2-4365-8a3d-4c4f603c1567 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:34.504405 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-7fa212e0-97d2-4365-8a3d-4c4f603c1567 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:34.515340 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-07aa0cb1-5a82-4573-8994-35385d319eaa req-730201de-64da-46d2-9250-cb48d3e32d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b69386-ba6a-4cd5-9ae8-7c693f14b14b", "name": "network-vif-deleted", "tag": "1fa1eac4-ae34-4463-ba02-c082a24c8e47"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:34.519539 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7fa212e0-97d2-4365-8a3d-4c4f603c1567 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:34.520136 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7fa212e0-97d2-4365-8a3d-4c4f603c1567 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:34.521065 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7fa212e0-97d2-4365-8a3d-4c4f603c1567 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:34.521754 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7fa212e0-97d2-4365-8a3d-4c4f603c1567 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:34.542716 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-07aa0cb1-5a82-4573-8994-35385d319eaa req-730201de-64da-46d2-9250-cb48d3e32d04 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:34.544203 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-07aa0cb1-5a82-4573-8994-35385d319eaa req-730201de-64da-46d2-9250-cb48d3e32d04 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:34.584391 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-07aa0cb1-5a82-4573-8994-35385d319eaa req-730201de-64da-46d2-9250-cb48d3e32d04 service nova] Creating event network-vif-deleted:1fa1eac4-ae34-4463-ba02-c082a24c8e47 for instance 48b69386-ba6a-4cd5-9ae8-7c693f14b14b on hv-cinder-80475 May 19 12:31:34.596634 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-07aa0cb1-5a82-4573-8994-35385d319eaa req-730201de-64da-46d2-9250-cb48d3e32d04 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088680 May 19 12:31:34.601364 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 623/1193] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:31:34.637779 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-7fa212e0-97d2-4365-8a3d-4c4f603c1567 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:34.650336 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-7fa212e0-97d2-4365-8a3d-4c4f603c1567 tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1429 microversion: 2.1 time: 0.154032 May 19 12:31:34.651854 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 571/1194] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:34 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1429 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:35.677977 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a4a3cc7a-697f-4a16-bc66-264ee2be7d1a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:35.679608 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a4a3cc7a-697f-4a16-bc66-264ee2be7d1a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:35.688342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a4a3cc7a-697f-4a16-bc66-264ee2be7d1a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:35.688794 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a4a3cc7a-697f-4a16-bc66-264ee2be7d1a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:35.689662 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a4a3cc7a-697f-4a16-bc66-264ee2be7d1a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:35.690105 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a4a3cc7a-697f-4a16-bc66-264ee2be7d1a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:35.693451 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:35.731381 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a4a3cc7a-697f-4a16-bc66-264ee2be7d1a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:35.731829 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a4a3cc7a-697f-4a16-bc66-264ee2be7d1a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:35.732300 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-a4a3cc7a-697f-4a16-bc66-264ee2be7d1a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lazy-loading 'fault' on Instance uuid 48b69386-ba6a-4cd5-9ae8-7c693f14b14b {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:31:35.799116 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a4a3cc7a-697f-4a16-bc66-264ee2be7d1a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9922026c1784ed4bd40bbb5c139cf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c8ec22ac914f63a81e67c98d018815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:35.808063 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a4a3cc7a-697f-4a16-bc66-264ee2be7d1a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 200 len: 1305 microversion: 2.1 time: 0.135970 May 19 12:31:35.809045 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 624/1195] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:35 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 1305 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:36.833839 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a8e10e34-3437-4b02-8a26-00d2ad3b0f9a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:36.834649 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a8e10e34-3437-4b02-8a26-00d2ad3b0f9a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] [instance: 48b69386-ba6a-4cd5-9ae8-7c693f14b14b] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:36.843570 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a8e10e34-3437-4b02-8a26-00d2ad3b0f9a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:36.848729 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a8e10e34-3437-4b02-8a26-00d2ad3b0f9a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:36.848729 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a8e10e34-3437-4b02-8a26-00d2ad3b0f9a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:36.848729 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a8e10e34-3437-4b02-8a26-00d2ad3b0f9a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:36.861605 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-a8e10e34-3437-4b02-8a26-00d2ad3b0f9a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] HTTP exception thrown: Instance 48b69386-ba6a-4cd5-9ae8-7c693f14b14b could not be found. May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a8e10e34-3437-4b02-8a26-00d2ad3b0f9a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Request method failure captured: May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b HTTP/1.1 May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjiJkplCjVhIdvww95VfsRO_2VpDnh7RV3JdFtvkUQrQKgD07BZgFvcAPkxYLTinjUo-1enreUczWFWpiaFlTm0w2CFL0U5qDaGLPy7IfYG31D5cai8HV_qsTP5vnB45riZj9tJXJnFDnfRJU2ZaX1CTbvF1A9ABRmJ9P-IOsRYjiXA May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 03c8ec22ac914f63a81e67c98d018815 May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-VolumesNegativeTest-1851038567 May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:31:36.865667 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:31:36.868757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03c8ec22ac914f63a81e67c98d018815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03c8ec22ac914f63a81e67c98d018815"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03c8ec22ac914f63a81e67c98d018815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03c8ec22ac914f63a81e67c98d018815"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:31:36.868757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-VolumesNegativeTest-1851038567 May 19 12:31:36.868757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 03c8ec22ac914f63a81e67c98d018815 May 19 12:31:36.868757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-VolumesNegativeTest-1851038567 May 19 12:31:36.868757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-VolumesNegativeTest-1851038567-project May 19 12:31:36.868757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:31:36.868757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:31:36.868757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: d9922026c1784ed4bd40bbb5c139cf04 May 19 12:31:36.868757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-VolumesNegativeTest-1851038567-project May 19 12:31:36.868757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:31:36.868757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance 48b69386-ba6a-4cd5-9ae8-7c693f14b14b could not be found. May 19 12:31:36.868757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': '48b69386-ba6a-4cd5-9ae8-7c693f14b14b'} May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48b69386-ba6a-4cd5-9ae8-7c693f14b14b could not be found. May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:31:36.870521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:31:36.873244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:31:36.873244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:31:36.873244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:31:36.873244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:31:36.873244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:31:36.873244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:31:36.873244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:31:36.873244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48b69386-ba6a-4cd5-9ae8-7c693f14b14b could not be found. May 19 12:31:36.873244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:31:36.873244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:31:36.873244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:31:36.873244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:36.873244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:31:36.873244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:31:36.873244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:31:36.873244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:31:36.873244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48b69386-ba6a-4cd5-9ae8-7c693f14b14b could not be found. May 19 12:31:36.873244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:31:36.877221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a8e10e34-3437-4b02-8a26-00d2ad3b0f9a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] Returning 404 to user: Instance 48b69386-ba6a-4cd5-9ae8-7c693f14b14b could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:31:36.877221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a8e10e34-3437-4b02-8a26-00d2ad3b0f9a tempest-VolumesNegativeTest-1851038567 tempest-VolumesNegativeTest-1851038567-project] 10.222.0.23 "GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b" status: 404 len: 111 microversion: 2.1 time: 0.037519 May 19 12:31:36.877221 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 572/1196] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:31:36 2022] GET /compute/v2.1/servers/48b69386-ba6a-4cd5-9ae8-7c693f14b14b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:32:30.276662 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-75cffb3f-f74e-4592-b90a-907456a22e1a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1525658239", "imageRef": "962252c6-9c2c-4b81-bdb7-f6d317bada3b", "flavorRef": "452", "networks": [{"uuid": "ef42f330-ede2-4f6c-afd0-f38527a9cb1c"}]}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:32:30.284520 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:30.349773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-75cffb3f-f74e-4592-b90a-907456a22e1a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] validate_networks() for [('ef42f330-ede2-4f6c-afd0-f38527a9cb1c', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:32:30.824474 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-75cffb3f-f74e-4592-b90a-907456a22e1a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:32:30.825224 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-75cffb3f-f74e-4592-b90a-907456a22e1a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:32:30.826097 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-75cffb3f-f74e-4592-b90a-907456a22e1a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:32:30.826869 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-75cffb3f-f74e-4592-b90a-907456a22e1a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:32:30.827638 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-75cffb3f-f74e-4592-b90a-907456a22e1a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:32:30.845406 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-75cffb3f-f74e-4592-b90a-907456a22e1a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:30.846472 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-75cffb3f-f74e-4592-b90a-907456a22e1a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:30.848074 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-75cffb3f-f74e-4592-b90a-907456a22e1a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:30.848906 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-75cffb3f-f74e-4592-b90a-907456a22e1a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:30.884831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-75cffb3f-f74e-4592-b90a-907456a22e1a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Getting quotas for project b0b15da1cdfb45c88bb7827e650d33c9. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:32:30.893124 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-75cffb3f-f74e-4592-b90a-907456a22e1a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Getting quotas for user f901fc3ba9b24c39a252aa5a7c9d431c and project b0b15da1cdfb45c88bb7827e650d33c9. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:32:30.915086 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-75cffb3f-f74e-4592-b90a-907456a22e1a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:32:30.920199 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-75cffb3f-f74e-4592-b90a-907456a22e1a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962252c6-9c2c-4b81-bdb7-f6d317bada3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:32:31.153903 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-75cffb3f-f74e-4592-b90a-907456a22e1a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.881070 May 19 12:32:31.154465 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 625/1197] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:32:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 12:32:31.164715 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-824d70fe-e2f0-4c74-b56f-195a305b8ae4 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:31.165470 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-824d70fe-e2f0-4c74-b56f-195a305b8ae4 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:31.168969 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=39 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:31.169658 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=89 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:31.232823 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-824d70fe-e2f0-4c74-b56f-195a305b8ae4 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:31.243448 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-824d70fe-e2f0-4c74-b56f-195a305b8ae4 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42" status: 200 len: 1219 microversion: 2.1 time: 0.082574 May 19 12:32:31.244462 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 573/1198] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:32:31 2022] GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:32:32.265745 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f5d864a1-cf0f-4474-aeb0-8c68408dd47d tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:32.266318 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f5d864a1-cf0f-4474-aeb0-8c68408dd47d tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:32.321462 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f5d864a1-cf0f-4474-aeb0-8c68408dd47d tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:32.329505 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f5d864a1-cf0f-4474-aeb0-8c68408dd47d tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42" status: 200 len: 1219 microversion: 2.1 time: 0.069430 May 19 12:32:32.330077 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 626/1199] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:32:32 2022] GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:33.346855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-2c4777ad-583a-4dc1-93b0-76bfa2fb92c0 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:33.347520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-2c4777ad-583a-4dc1-93b0-76bfa2fb92c0 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:33.355343 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2c4777ad-583a-4dc1-93b0-76bfa2fb92c0 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:33.355862 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2c4777ad-583a-4dc1-93b0-76bfa2fb92c0 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:33.356659 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2c4777ad-583a-4dc1-93b0-76bfa2fb92c0 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:33.357112 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-2c4777ad-583a-4dc1-93b0-76bfa2fb92c0 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:33.426482 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-2c4777ad-583a-4dc1-93b0-76bfa2fb92c0 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:33.435720 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-2c4777ad-583a-4dc1-93b0-76bfa2fb92c0 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42" status: 200 len: 1271 microversion: 2.1 time: 0.092749 May 19 12:32:33.436341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 574/1200] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:32:33 2022] GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:32:34.455362 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6eadb40c-86b4-46a0-b8e7-b542f0e80a92 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:34.462231 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6eadb40c-86b4-46a0-b8e7-b542f0e80a92 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:34.465772 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6eadb40c-86b4-46a0-b8e7-b542f0e80a92 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:34.466428 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6eadb40c-86b4-46a0-b8e7-b542f0e80a92 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:34.467377 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6eadb40c-86b4-46a0-b8e7-b542f0e80a92 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:34.467963 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6eadb40c-86b4-46a0-b8e7-b542f0e80a92 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:34.569768 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6eadb40c-86b4-46a0-b8e7-b542f0e80a92 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:34.580502 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6eadb40c-86b4-46a0-b8e7-b542f0e80a92 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42" status: 200 len: 1277 microversion: 2.1 time: 0.130462 May 19 12:32:34.581310 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 627/1201] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:32:34 2022] GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 => generated 1277 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:32:35.600577 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-cd2c9905-388e-4a92-be73-0fd6ba86441b tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:35.601472 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-cd2c9905-388e-4a92-be73-0fd6ba86441b tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:35.612360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-cd2c9905-388e-4a92-be73-0fd6ba86441b tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:35.613176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-cd2c9905-388e-4a92-be73-0fd6ba86441b tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:35.614978 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-cd2c9905-388e-4a92-be73-0fd6ba86441b tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:35.615842 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-cd2c9905-388e-4a92-be73-0fd6ba86441b tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:35.773072 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-cd2c9905-388e-4a92-be73-0fd6ba86441b tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:35.782069 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-cd2c9905-388e-4a92-be73-0fd6ba86441b tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42" status: 200 len: 1319 microversion: 2.1 time: 0.185490 May 19 12:32:35.782658 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 575/1202] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:32:35 2022] GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:35.857948 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-359899c0-cb09-4fec-a76c-0039532b5f12 req-9c96f824-ade4-4d0c-b4fc-0545c9a8b548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ff9de21-e70b-4381-9dfc-e7dfb15d1c42", "tag": "6fe51d38-62a2-4b50-8614-8fab1516d602"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:32:35.874421 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-359899c0-cb09-4fec-a76c-0039532b5f12 req-9c96f824-ade4-4d0c-b4fc-0545c9a8b548 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:35.875350 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-359899c0-cb09-4fec-a76c-0039532b5f12 req-9c96f824-ade4-4d0c-b4fc-0545c9a8b548 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:35.895108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-359899c0-cb09-4fec-a76c-0039532b5f12 req-9c96f824-ade4-4d0c-b4fc-0545c9a8b548 service nova] Creating event network-changed:6fe51d38-62a2-4b50-8614-8fab1516d602 for instance 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 on hv-cinder-80475 May 19 12:32:35.901773 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-359899c0-cb09-4fec-a76c-0039532b5f12 req-9c96f824-ade4-4d0c-b4fc-0545c9a8b548 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050187 May 19 12:32:35.902408 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 628/1203] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:32:36.804859 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9a017eca-d0ed-4194-bea6-5bf3272ada9f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:36.810906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9a017eca-d0ed-4194-bea6-5bf3272ada9f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:36.814670 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9a017eca-d0ed-4194-bea6-5bf3272ada9f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:36.815126 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9a017eca-d0ed-4194-bea6-5bf3272ada9f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:36.815975 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9a017eca-d0ed-4194-bea6-5bf3272ada9f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:36.816415 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9a017eca-d0ed-4194-bea6-5bf3272ada9f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:37.018859 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9a017eca-d0ed-4194-bea6-5bf3272ada9f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:37.032533 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9a017eca-d0ed-4194-bea6-5bf3272ada9f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42" status: 200 len: 1319 microversion: 2.1 time: 0.231977 May 19 12:32:37.033593 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 576/1204] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:32:36 2022] GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:38.054189 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c8ead471-d812-4a94-b327-aee9727352ea tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:38.054992 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c8ead471-d812-4a94-b327-aee9727352ea tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:38.063942 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c8ead471-d812-4a94-b327-aee9727352ea tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:38.064396 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c8ead471-d812-4a94-b327-aee9727352ea tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:38.065268 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c8ead471-d812-4a94-b327-aee9727352ea tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:38.065711 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c8ead471-d812-4a94-b327-aee9727352ea tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:38.254392 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c8ead471-d812-4a94-b327-aee9727352ea tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:38.262497 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c8ead471-d812-4a94-b327-aee9727352ea tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42" status: 200 len: 1319 microversion: 2.1 time: 0.213645 May 19 12:32:38.263144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 629/1205] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:32:38 2022] GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:39.280900 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-fdbfd34d-20c5-4b82-a104-6bf8daad86f1 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:39.281787 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-fdbfd34d-20c5-4b82-a104-6bf8daad86f1 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:39.289119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fdbfd34d-20c5-4b82-a104-6bf8daad86f1 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:39.289762 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fdbfd34d-20c5-4b82-a104-6bf8daad86f1 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:39.291286 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fdbfd34d-20c5-4b82-a104-6bf8daad86f1 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:39.292004 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fdbfd34d-20c5-4b82-a104-6bf8daad86f1 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:39.443632 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-fdbfd34d-20c5-4b82-a104-6bf8daad86f1 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:39.452627 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-fdbfd34d-20c5-4b82-a104-6bf8daad86f1 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42" status: 200 len: 1319 microversion: 2.1 time: 0.175634 May 19 12:32:39.453452 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 577/1206] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:32:39 2022] GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:32:40.471493 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f50aceaa-a113-4f35-bb4a-9650f7f9a942 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:40.472381 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f50aceaa-a113-4f35-bb4a-9650f7f9a942 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:40.481150 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f50aceaa-a113-4f35-bb4a-9650f7f9a942 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:40.481792 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f50aceaa-a113-4f35-bb4a-9650f7f9a942 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:40.482841 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f50aceaa-a113-4f35-bb4a-9650f7f9a942 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:40.483382 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f50aceaa-a113-4f35-bb4a-9650f7f9a942 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:40.671457 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f50aceaa-a113-4f35-bb4a-9650f7f9a942 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:40.677181 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f50aceaa-a113-4f35-bb4a-9650f7f9a942 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42" status: 200 len: 1319 microversion: 2.1 time: 0.210370 May 19 12:32:40.677786 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 630/1207] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:32:40 2022] GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:41.694924 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-04a80f80-fed7-4dcb-9cc9-112af6314e7e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:41.695541 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-04a80f80-fed7-4dcb-9cc9-112af6314e7e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:41.698750 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=2 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:41.704258 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-04a80f80-fed7-4dcb-9cc9-112af6314e7e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:41.704709 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-04a80f80-fed7-4dcb-9cc9-112af6314e7e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:41.705495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-04a80f80-fed7-4dcb-9cc9-112af6314e7e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:41.705925 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-04a80f80-fed7-4dcb-9cc9-112af6314e7e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:41.857084 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-04a80f80-fed7-4dcb-9cc9-112af6314e7e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:41.870655 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-04a80f80-fed7-4dcb-9cc9-112af6314e7e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42" status: 200 len: 1319 microversion: 2.1 time: 0.174551 May 19 12:32:41.870655 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 578/1208] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:32:41 2022] GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:42.739602 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-ce5dfa4c-dfcb-40b4-ab31-c9e828c128b1 req-6ebf2d14-8431-49f6-81cc-42c67271450b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ff9de21-e70b-4381-9dfc-e7dfb15d1c42", "name": "network-vif-plugged", "status": "completed", "tag": "6fe51d38-62a2-4b50-8614-8fab1516d602"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:32:42.745515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:42.745790 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=8 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:42.752085 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-ce5dfa4c-dfcb-40b4-ab31-c9e828c128b1 req-6ebf2d14-8431-49f6-81cc-42c67271450b service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:42.752529 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-ce5dfa4c-dfcb-40b4-ab31-c9e828c128b1 req-6ebf2d14-8431-49f6-81cc-42c67271450b service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:42.765652 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-ce5dfa4c-dfcb-40b4-ab31-c9e828c128b1 req-6ebf2d14-8431-49f6-81cc-42c67271450b service nova] Creating event network-vif-plugged:6fe51d38-62a2-4b50-8614-8fab1516d602 for instance 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 on hv-cinder-80475 May 19 12:32:42.771106 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-ce5dfa4c-dfcb-40b4-ab31-c9e828c128b1 req-6ebf2d14-8431-49f6-81cc-42c67271450b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035439 May 19 12:32:42.771905 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 631/1209] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:32:42.885554 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-807b9205-0007-4f37-a111-79a304366da6 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:42.885554 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-807b9205-0007-4f37-a111-79a304366da6 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:42.893075 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-807b9205-0007-4f37-a111-79a304366da6 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:42.893609 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-807b9205-0007-4f37-a111-79a304366da6 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:42.894414 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-807b9205-0007-4f37-a111-79a304366da6 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:42.894855 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-807b9205-0007-4f37-a111-79a304366da6 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:43.061631 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-807b9205-0007-4f37-a111-79a304366da6 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:43.075216 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-807b9205-0007-4f37-a111-79a304366da6 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42" status: 200 len: 1319 microversion: 2.1 time: 0.194551 May 19 12:32:43.075889 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 579/1210] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:32:42 2022] GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:44.094356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-92b7f18c-990a-4d52-ac73-5205da2163ee tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:44.095083 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-92b7f18c-990a-4d52-ac73-5205da2163ee tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:44.102579 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-92b7f18c-990a-4d52-ac73-5205da2163ee tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:44.103027 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-92b7f18c-990a-4d52-ac73-5205da2163ee tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:44.104602 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-92b7f18c-990a-4d52-ac73-5205da2163ee tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:44.105391 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-92b7f18c-990a-4d52-ac73-5205da2163ee tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:44.268530 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-92b7f18c-990a-4d52-ac73-5205da2163ee tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:44.278625 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-92b7f18c-990a-4d52-ac73-5205da2163ee tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42" status: 200 len: 1319 microversion: 2.1 time: 0.189789 May 19 12:32:44.279234 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 632/1211] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:32:44 2022] GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:45.298693 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-86859548-c29b-47e6-9092-2a90167a5521 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:45.299676 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-86859548-c29b-47e6-9092-2a90167a5521 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:45.310325 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-86859548-c29b-47e6-9092-2a90167a5521 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:45.310795 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-86859548-c29b-47e6-9092-2a90167a5521 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:45.311583 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-86859548-c29b-47e6-9092-2a90167a5521 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:45.312053 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-86859548-c29b-47e6-9092-2a90167a5521 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:45.458332 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-86859548-c29b-47e6-9092-2a90167a5521 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:45.467139 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-86859548-c29b-47e6-9092-2a90167a5521 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42" status: 200 len: 1508 microversion: 2.1 time: 0.174702 May 19 12:32:45.467738 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 580/1212] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:32:45 2022] GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:09.696553 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-21bd0721-7601-4a91-b432-68d3e6b3f94f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e565b4f8-5d2f-40f0-9f0d-eb3a45259c27", "device": "/dev/sdb"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:33:09.698736 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-21bd0721-7601-4a91-b432-68d3e6b3f94f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:09.700932 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:09.701789 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=37 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:09.706870 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-21bd0721-7601-4a91-b432-68d3e6b3f94f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:09.707321 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-21bd0721-7601-4a91-b432-68d3e6b3f94f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:09.708175 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-21bd0721-7601-4a91-b432-68d3e6b3f94f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:09.708627 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-21bd0721-7601-4a91-b432-68d3e6b3f94f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:10.115648 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:33:10.116290 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Thu May 19 12:33:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:33:10.792510 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-21bd0721-7601-4a91-b432-68d3e6b3f94f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "POST /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.099948 May 19 12:33:10.793180 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 633/1213] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 19 12:33:09 2022] POST /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42/os-volume_attachments => generated 194 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:33:14.432538 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:33:14.433468 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Thu May 19 12:33:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:33:40.235489 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-694e8743-235c-4452-848c-d84f830d1d82 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:40.236425 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-694e8743-235c-4452-848c-d84f830d1d82 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:40.240178 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=18 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:40.241534 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=42 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:40.250772 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-694e8743-235c-4452-848c-d84f830d1d82 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:40.254710 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-694e8743-235c-4452-848c-d84f830d1d82 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:40.254710 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-694e8743-235c-4452-848c-d84f830d1d82 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:40.254710 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-694e8743-235c-4452-848c-d84f830d1d82 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:40.464293 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.objects.instance [None req-694e8743-235c-4452-848c-d84f830d1d82 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lazy-loading 'services' on Instance uuid 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 {{(pid=117964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:33:40.706702 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-694e8743-235c-4452-848c-d84f830d1d82 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42/os-volume_attachments/e565b4f8-5d2f-40f0-9f0d-eb3a45259c27" status: 202 len: 0 microversion: 2.1 time: 0.479469 May 19 12:33:40.707486 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 581/1214] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 19 12:33:40 2022] DELETE /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42/os-volume_attachments/e565b4f8-5d2f-40f0-9f0d-eb3a45259c27 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:33:41.933051 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:41.933888 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:41.938426 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f35d9b8b-dfc3-4e9c-aac4-1b71db6a525a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:41.939168 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f35d9b8b-dfc3-4e9c-aac4-1b71db6a525a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:41.947836 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f35d9b8b-dfc3-4e9c-aac4-1b71db6a525a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:41.948625 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f35d9b8b-dfc3-4e9c-aac4-1b71db6a525a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:41.949688 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f35d9b8b-dfc3-4e9c-aac4-1b71db6a525a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:41.950315 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f35d9b8b-dfc3-4e9c-aac4-1b71db6a525a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:41.983945 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f35d9b8b-dfc3-4e9c-aac4-1b71db6a525a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:33:42.426867 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f35d9b8b-dfc3-4e9c-aac4-1b71db6a525a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42" status: 204 len: 0 microversion: 2.1 time: 0.495819 May 19 12:33:42.427468 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 634/1215] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:33:41 2022] DELETE /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:33:42.443170 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a6c0c183-021b-4e9a-a943-92cdd5e7a7b2 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:42.444664 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a6c0c183-021b-4e9a-a943-92cdd5e7a7b2 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:42.458045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a6c0c183-021b-4e9a-a943-92cdd5e7a7b2 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:42.458838 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a6c0c183-021b-4e9a-a943-92cdd5e7a7b2 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:42.460485 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a6c0c183-021b-4e9a-a943-92cdd5e7a7b2 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:42.461347 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a6c0c183-021b-4e9a-a943-92cdd5e7a7b2 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:42.647502 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a6c0c183-021b-4e9a-a943-92cdd5e7a7b2 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:42.656098 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a6c0c183-021b-4e9a-a943-92cdd5e7a7b2 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42" status: 200 len: 1514 microversion: 2.1 time: 0.221890 May 19 12:33:42.656688 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 582/1216] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:33:42 2022] GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:43.675255 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-df20590e-893e-44db-b322-449ae6902e37 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:43.676086 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-df20590e-893e-44db-b322-449ae6902e37 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:43.684108 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df20590e-893e-44db-b322-449ae6902e37 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:43.684683 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df20590e-893e-44db-b322-449ae6902e37 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:43.685545 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df20590e-893e-44db-b322-449ae6902e37 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:43.686029 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-df20590e-893e-44db-b322-449ae6902e37 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:43.864591 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-df20590e-893e-44db-b322-449ae6902e37 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:43.873356 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-df20590e-893e-44db-b322-449ae6902e37 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42" status: 200 len: 1514 microversion: 2.1 time: 0.202374 May 19 12:33:43.873956 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 635/1217] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:33:43 2022] GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 => generated 1514 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:33:44.894882 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5e2c6bf3-c8cd-4725-b5b0-6a562c539107 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:44.896465 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5e2c6bf3-c8cd-4725-b5b0-6a562c539107 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:44.904897 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5e2c6bf3-c8cd-4725-b5b0-6a562c539107 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:44.905451 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5e2c6bf3-c8cd-4725-b5b0-6a562c539107 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:44.906382 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5e2c6bf3-c8cd-4725-b5b0-6a562c539107 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:44.906979 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5e2c6bf3-c8cd-4725-b5b0-6a562c539107 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:45.105833 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5e2c6bf3-c8cd-4725-b5b0-6a562c539107 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:45.114910 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5e2c6bf3-c8cd-4725-b5b0-6a562c539107 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42" status: 200 len: 1514 microversion: 2.1 time: 0.226919 May 19 12:33:45.116082 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 583/1218] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:33:44 2022] GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:45.285370 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-8b200ac1-50d4-4b85-ab11-a522d6a4b20b req-0ed10d77-c5ae-4778-a80e-0b86ad8f03df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ff9de21-e70b-4381-9dfc-e7dfb15d1c42", "name": "network-vif-deleted", "tag": "6fe51d38-62a2-4b50-8614-8fab1516d602"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:33:45.296651 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-8b200ac1-50d4-4b85-ab11-a522d6a4b20b req-0ed10d77-c5ae-4778-a80e-0b86ad8f03df service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:45.297166 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-8b200ac1-50d4-4b85-ab11-a522d6a4b20b req-0ed10d77-c5ae-4778-a80e-0b86ad8f03df service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:45.312193 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-8b200ac1-50d4-4b85-ab11-a522d6a4b20b req-0ed10d77-c5ae-4778-a80e-0b86ad8f03df service nova] Creating event network-vif-deleted:6fe51d38-62a2-4b50-8614-8fab1516d602 for instance 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 on hv-cinder-80475 May 19 12:33:45.319235 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-8b200ac1-50d4-4b85-ab11-a522d6a4b20b req-0ed10d77-c5ae-4778-a80e-0b86ad8f03df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037196 May 19 12:33:45.320462 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 636/1219] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:33:46.135752 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-7865741c-e90b-403e-a6ed-69ccca024762 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:46.136491 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-7865741c-e90b-403e-a6ed-69ccca024762 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:46.144487 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7865741c-e90b-403e-a6ed-69ccca024762 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:46.144931 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7865741c-e90b-403e-a6ed-69ccca024762 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:46.148814 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7865741c-e90b-403e-a6ed-69ccca024762 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:46.148814 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7865741c-e90b-403e-a6ed-69ccca024762 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:46.185584 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7865741c-e90b-403e-a6ed-69ccca024762 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:46.186030 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-7865741c-e90b-403e-a6ed-69ccca024762 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:46.186493 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.objects.instance [None req-7865741c-e90b-403e-a6ed-69ccca024762 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lazy-loading 'fault' on Instance uuid 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 {{(pid=117964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:33:46.238598 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-7865741c-e90b-403e-a6ed-69ccca024762 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:46.253744 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-7865741c-e90b-403e-a6ed-69ccca024762 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42" status: 200 len: 1309 microversion: 2.1 time: 0.122387 May 19 12:33:46.254813 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 584/1220] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:33:46 2022] GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 => generated 1309 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:47.280755 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1c92cc8d-a8a6-452d-9402-9e38b3ea4ce4 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:47.281426 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1c92cc8d-a8a6-452d-9402-9e38b3ea4ce4 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:47.288382 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1c92cc8d-a8a6-452d-9402-9e38b3ea4ce4 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:47.288830 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1c92cc8d-a8a6-452d-9402-9e38b3ea4ce4 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:47.289620 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1c92cc8d-a8a6-452d-9402-9e38b3ea4ce4 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:47.290054 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1c92cc8d-a8a6-452d-9402-9e38b3ea4ce4 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:47.305928 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-1c92cc8d-a8a6-452d-9402-9e38b3ea4ce4 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] HTTP exception thrown: Instance 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 could not be found. May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1c92cc8d-a8a6-452d-9402-9e38b3ea4ce4 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Request method failure captured: May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 HTTP/1.1 May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjjcpFMIT_sHr_abnliO10TGYcmu7cWZQ-urIEI1MsS2tgACUE5uOnN-Gc97SzbaQuDMZrmgijSz3WeJ6U0-5ySd8OW-P1yEBYmG1KxYQWp_PJrL-7UKAYPjJbdLa_Q0mctC5gCxJrU0K7foRb5faFR0qjVNazJ4qtSvhI4WDQaLJr4 May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: b0b15da1cdfb45c88bb7827e650d33c9 May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2107081936 May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:33:47.307831 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:33:47.311130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b0b15da1cdfb45c88bb7827e650d33c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b0b15da1cdfb45c88bb7827e650d33c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b0b15da1cdfb45c88bb7827e650d33c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b0b15da1cdfb45c88bb7827e650d33c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:33:47.311130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-VolumesSnapshotTestJSON-2107081936 May 19 12:33:47.311130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: b0b15da1cdfb45c88bb7827e650d33c9 May 19 12:33:47.311130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2107081936 May 19 12:33:47.311130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-VolumesSnapshotTestJSON-2107081936-project May 19 12:33:47.311130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:33:47.311130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:33:47.311130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: f901fc3ba9b24c39a252aa5a7c9d431c May 19 12:33:47.311130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-VolumesSnapshotTestJSON-2107081936-project May 19 12:33:47.311130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:33:47.311130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 could not be found. May 19 12:33:47.311130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': '9ff9de21-e70b-4381-9dfc-e7dfb15d1c42'} May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 could not be found. May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:33:47.313003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:33:47.315609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:33:47.315609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:33:47.315609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:33:47.315609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:33:47.315609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:33:47.315609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:33:47.315609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:33:47.315609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 could not be found. May 19 12:33:47.315609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:33:47.315609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:33:47.315609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:33:47.315609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:33:47.315609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:33:47.315609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:33:47.315609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:33:47.315609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:33:47.315609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 could not be found. May 19 12:33:47.315609 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:33:47.318206 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1c92cc8d-a8a6-452d-9402-9e38b3ea4ce4 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Returning 404 to user: Instance 9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:33:47.318206 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1c92cc8d-a8a6-452d-9402-9e38b3ea4ce4 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42" status: 404 len: 111 microversion: 2.1 time: 0.034332 May 19 12:33:47.318206 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 637/1221] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:33:47 2022] GET /compute/v2.1/servers/9ff9de21-e70b-4381-9dfc-e7dfb15d1c42 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:34:03.303067 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ed788ec2-c3f1-4f2e-a378-1ba47692092a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-243973138", "imageRef": "962252c6-9c2c-4b81-bdb7-f6d317bada3b", "flavorRef": "452", "networks": [{"uuid": "ef42f330-ede2-4f6c-afd0-f38527a9cb1c"}]}} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:03.311101 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=10 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:03.311751 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:03.377696 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.network.neutron [None req-ed788ec2-c3f1-4f2e-a378-1ba47692092a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] validate_networks() for [('ef42f330-ede2-4f6c-afd0-f38527a9cb1c', None, None, None, None, None)] {{(pid=117964) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:34:03.851609 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-ed788ec2-c3f1-4f2e-a378-1ba47692092a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Flavor limits 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:34:03.852066 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-ed788ec2-c3f1-4f2e-a378-1ba47692092a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Image limits 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:34:03.852672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-ed788ec2-c3f1-4f2e-a378-1ba47692092a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Flavor pref 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:34:03.853600 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-ed788ec2-c3f1-4f2e-a378-1ba47692092a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Image pref 0:0:0 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:34:03.854008 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.virt.hardware [None req-ed788ec2-c3f1-4f2e-a378-1ba47692092a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:34:03.863969 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ed788ec2-c3f1-4f2e-a378-1ba47692092a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:03.864419 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ed788ec2-c3f1-4f2e-a378-1ba47692092a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:03.865219 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ed788ec2-c3f1-4f2e-a378-1ba47692092a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:03.865650 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ed788ec2-c3f1-4f2e-a378-1ba47692092a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:03.886052 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-ed788ec2-c3f1-4f2e-a378-1ba47692092a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Getting quotas for project b0b15da1cdfb45c88bb7827e650d33c9. Resources: {'instances', 'ram', 'cores'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:34:03.890679 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.quota [None req-ed788ec2-c3f1-4f2e-a378-1ba47692092a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Getting quotas for user f901fc3ba9b24c39a252aa5a7c9d431c and project b0b15da1cdfb45c88bb7827e650d33c9. Resources: {'instances', 'ram', 'cores'} {{(pid=117964) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:34:03.903378 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ed788ec2-c3f1-4f2e-a378-1ba47692092a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Going to run 1 instances... {{(pid=117964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:34:03.905840 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ed788ec2-c3f1-4f2e-a378-1ba47692092a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962252c6-9c2c-4b81-bdb7-f6d317bada3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:34:04.119662 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ed788ec2-c3f1-4f2e-a378-1ba47692092a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820495 May 19 12:34:04.120281 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 585/1222] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:34:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 12:34:04.130276 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f4f2549f-d638-4053-8b1f-d492ece8ac9a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:04.130905 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f4f2549f-d638-4053-8b1f-d492ece8ac9a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:04.138420 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:04.139417 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:04.199809 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f4f2549f-d638-4053-8b1f-d492ece8ac9a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:04.214540 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f4f2549f-d638-4053-8b1f-d492ece8ac9a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 200 len: 1218 microversion: 2.1 time: 0.087676 May 19 12:34:04.215575 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 638/1223] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:04 2022] GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:05.233820 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-262454a2-57dc-4919-8ba3-b4f601abfe99 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:05.234411 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-262454a2-57dc-4919-8ba3-b4f601abfe99 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:05.295591 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-262454a2-57dc-4919-8ba3-b4f601abfe99 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:05.305262 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-262454a2-57dc-4919-8ba3-b4f601abfe99 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 200 len: 1218 microversion: 2.1 time: 0.076746 May 19 12:34:05.307618 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 586/1224] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:05 2022] GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:06.329003 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f93a31ce-554a-4dcb-81cc-1e248fd6b907 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:06.329728 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f93a31ce-554a-4dcb-81cc-1e248fd6b907 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:06.338818 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f93a31ce-554a-4dcb-81cc-1e248fd6b907 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:06.355196 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f93a31ce-554a-4dcb-81cc-1e248fd6b907 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:06.355196 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f93a31ce-554a-4dcb-81cc-1e248fd6b907 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:06.355196 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f93a31ce-554a-4dcb-81cc-1e248fd6b907 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:06.411644 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f93a31ce-554a-4dcb-81cc-1e248fd6b907 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:06.420308 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f93a31ce-554a-4dcb-81cc-1e248fd6b907 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 200 len: 1270 microversion: 2.1 time: 0.095933 May 19 12:34:06.420886 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 639/1225] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:06 2022] GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:07.438516 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-d2fb2e44-5ba4-42bd-b59d-22d81d58c4d5 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:07.439150 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-d2fb2e44-5ba4-42bd-b59d-22d81d58c4d5 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:07.447224 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d2fb2e44-5ba4-42bd-b59d-22d81d58c4d5 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:07.447680 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d2fb2e44-5ba4-42bd-b59d-22d81d58c4d5 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:07.448554 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d2fb2e44-5ba4-42bd-b59d-22d81d58c4d5 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:07.448993 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-d2fb2e44-5ba4-42bd-b59d-22d81d58c4d5 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:07.523331 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-d2fb2e44-5ba4-42bd-b59d-22d81d58c4d5 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:07.533106 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-d2fb2e44-5ba4-42bd-b59d-22d81d58c4d5 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 200 len: 1278 microversion: 2.1 time: 0.098463 May 19 12:34:07.533574 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 587/1226] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:07 2022] GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 1278 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:08.552018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-33bac66b-0db1-4269-9fdd-3d49816a3887 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:08.552980 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-33bac66b-0db1-4269-9fdd-3d49816a3887 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:08.560964 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33bac66b-0db1-4269-9fdd-3d49816a3887 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:08.561408 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33bac66b-0db1-4269-9fdd-3d49816a3887 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:08.562195 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33bac66b-0db1-4269-9fdd-3d49816a3887 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:08.562704 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-33bac66b-0db1-4269-9fdd-3d49816a3887 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:08.723310 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-33bac66b-0db1-4269-9fdd-3d49816a3887 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:08.732016 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-33bac66b-0db1-4269-9fdd-3d49816a3887 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 200 len: 1318 microversion: 2.1 time: 0.184929 May 19 12:34:08.732604 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 640/1227] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:08 2022] GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:09.751936 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-70ac1498-cf40-46d1-a0a3-3faca9bbbe59 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:09.752843 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-70ac1498-cf40-46d1-a0a3-3faca9bbbe59 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:09.759657 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-70ac1498-cf40-46d1-a0a3-3faca9bbbe59 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:09.760464 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-70ac1498-cf40-46d1-a0a3-3faca9bbbe59 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:09.761286 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-70ac1498-cf40-46d1-a0a3-3faca9bbbe59 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:09.761792 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-70ac1498-cf40-46d1-a0a3-3faca9bbbe59 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:09.765062 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-aa88c8d9-3e6e-4a6c-bcfa-46a3c71b0ca2 req-b63ae3a4-c637-47f2-b846-016a3a4f4b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dab3f86a-d962-4614-b0ab-e29e6683c6dd", "tag": "e18e084c-caa5-44c4-9d89-b500c9b8fc96"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:09.783066 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-aa88c8d9-3e6e-4a6c-bcfa-46a3c71b0ca2 req-b63ae3a4-c637-47f2-b846-016a3a4f4b61 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:09.784365 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-aa88c8d9-3e6e-4a6c-bcfa-46a3c71b0ca2 req-b63ae3a4-c637-47f2-b846-016a3a4f4b61 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:09.804185 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-aa88c8d9-3e6e-4a6c-bcfa-46a3c71b0ca2 req-b63ae3a4-c637-47f2-b846-016a3a4f4b61 service nova] Creating event network-changed:e18e084c-caa5-44c4-9d89-b500c9b8fc96 for instance dab3f86a-d962-4614-b0ab-e29e6683c6dd on hv-cinder-80475 May 19 12:34:09.810277 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-aa88c8d9-3e6e-4a6c-bcfa-46a3c71b0ca2 req-b63ae3a4-c637-47f2-b846-016a3a4f4b61 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053911 May 19 12:34:09.810894 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 641/1228] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:34:09.912826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-70ac1498-cf40-46d1-a0a3-3faca9bbbe59 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:09.921925 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-70ac1498-cf40-46d1-a0a3-3faca9bbbe59 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 200 len: 1318 microversion: 2.1 time: 0.174889 May 19 12:34:09.922530 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 588/1229] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:09 2022] GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:10.113503 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-510e4c8f-8191-439e-9a2b-95cefb5b4a0e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-774053362", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1269836910", "security_groups": [{"name": "tempest-secgroup-smoke-422211665"}], "block_device_mapping_v2": [{"uuid": "48beb7dd-822c-458b-8bcc-709abf696d7a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8cb239d8-0b94-495c-8855-e9aad30a1cb5"}]}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:10.255658 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-510e4c8f-8191-439e-9a2b-95cefb5b4a0e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] validate_networks() for [('8cb239d8-0b94-495c-8855-e9aad30a1cb5', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:34:10.801863 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-510e4c8f-8191-439e-9a2b-95cefb5b4a0e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:34:10.802830 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-510e4c8f-8191-439e-9a2b-95cefb5b4a0e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:34:10.802830 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-510e4c8f-8191-439e-9a2b-95cefb5b4a0e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:34:10.803191 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-510e4c8f-8191-439e-9a2b-95cefb5b4a0e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:34:10.803613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-510e4c8f-8191-439e-9a2b-95cefb5b4a0e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:34:10.814061 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-510e4c8f-8191-439e-9a2b-95cefb5b4a0e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:10.814566 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-510e4c8f-8191-439e-9a2b-95cefb5b4a0e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:10.815382 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-510e4c8f-8191-439e-9a2b-95cefb5b4a0e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:10.815854 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-510e4c8f-8191-439e-9a2b-95cefb5b4a0e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:10.834766 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-510e4c8f-8191-439e-9a2b-95cefb5b4a0e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Getting quotas for project 4b46044a7f1d471582800c9d8a79e5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:34:10.840263 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-510e4c8f-8191-439e-9a2b-95cefb5b4a0e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Getting quotas for user 2d158b01a0a74de4bc0131b5c625efdf and project 4b46044a7f1d471582800c9d8a79e5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:34:10.913358 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-510e4c8f-8191-439e-9a2b-95cefb5b4a0e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:34:10.916270 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-510e4c8f-8191-439e-9a2b-95cefb5b4a0e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='48beb7dd-822c-458b-8bcc-709abf696d7a',volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:34:10.939215 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-ec20f3c2-991f-404b-bdd6-87684eb47d28 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:10.940572 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-ec20f3c2-991f-404b-bdd6-87684eb47d28 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:10.949656 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ec20f3c2-991f-404b-bdd6-87684eb47d28 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:10.950290 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ec20f3c2-991f-404b-bdd6-87684eb47d28 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:10.951606 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ec20f3c2-991f-404b-bdd6-87684eb47d28 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:10.952226 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-ec20f3c2-991f-404b-bdd6-87684eb47d28 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:11.126757 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-ec20f3c2-991f-404b-bdd6-87684eb47d28 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:11.140315 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-ec20f3c2-991f-404b-bdd6-87684eb47d28 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 200 len: 1318 microversion: 2.1 time: 0.205037 May 19 12:34:11.141233 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 589/1230] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:10 2022] GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:11.786337 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-510e4c8f-8191-439e-9a2b-95cefb5b4a0e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.676918 May 19 12:34:11.786854 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 642/1231] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 19 12:34:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:34:11.800858 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-3ab6d9e8-e1a8-48d9-9552-d08ffadefdb5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:11.801475 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-3ab6d9e8-e1a8-48d9-9552-d08ffadefdb5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:11.864821 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-3ab6d9e8-e1a8-48d9-9552-d08ffadefdb5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:11.875634 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-3ab6d9e8-e1a8-48d9-9552-d08ffadefdb5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1094 microversion: 2.1 time: 0.078213 May 19 12:34:11.886444 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 590/1232] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:11 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1094 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:12.165144 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e61bf25d-3477-4ba3-931b-5cac20b7794e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:12.166485 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e61bf25d-3477-4ba3-931b-5cac20b7794e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:12.172976 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e61bf25d-3477-4ba3-931b-5cac20b7794e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:12.173427 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e61bf25d-3477-4ba3-931b-5cac20b7794e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:12.174207 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e61bf25d-3477-4ba3-931b-5cac20b7794e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:12.174638 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e61bf25d-3477-4ba3-931b-5cac20b7794e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:12.347956 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e61bf25d-3477-4ba3-931b-5cac20b7794e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:12.356336 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e61bf25d-3477-4ba3-931b-5cac20b7794e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 200 len: 1318 microversion: 2.1 time: 0.195363 May 19 12:34:12.357020 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 643/1233] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:12 2022] GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:12.898183 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5a529910-9f18-481b-9dc2-895dd4fe3801 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:12.898817 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5a529910-9f18-481b-9dc2-895dd4fe3801 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:12.960891 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5a529910-9f18-481b-9dc2-895dd4fe3801 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:12.975097 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5a529910-9f18-481b-9dc2-895dd4fe3801 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1094 microversion: 2.1 time: 0.080390 May 19 12:34:12.976135 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 591/1234] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:12 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:13.374011 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-27e669a3-3aab-4af4-843a-0eb856910c89 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:13.374823 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-27e669a3-3aab-4af4-843a-0eb856910c89 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:13.382571 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-27e669a3-3aab-4af4-843a-0eb856910c89 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:13.383110 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-27e669a3-3aab-4af4-843a-0eb856910c89 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:13.384613 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-27e669a3-3aab-4af4-843a-0eb856910c89 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:13.385104 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-27e669a3-3aab-4af4-843a-0eb856910c89 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:13.535302 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-27e669a3-3aab-4af4-843a-0eb856910c89 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:13.544425 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-27e669a3-3aab-4af4-843a-0eb856910c89 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 200 len: 1318 microversion: 2.1 time: 0.174624 May 19 12:34:13.545028 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 644/1235] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:13 2022] GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:13.999611 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-238f4453-ef4d-4ed1-bad5-772b0f62af7d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:14.001889 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-238f4453-ef4d-4ed1-bad5-772b0f62af7d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:14.006687 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=2 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:14.017087 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-238f4453-ef4d-4ed1-bad5-772b0f62af7d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:14.017934 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-238f4453-ef4d-4ed1-bad5-772b0f62af7d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:14.019356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-238f4453-ef4d-4ed1-bad5-772b0f62af7d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:14.020213 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-238f4453-ef4d-4ed1-bad5-772b0f62af7d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:14.093439 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-238f4453-ef4d-4ed1-bad5-772b0f62af7d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:14.101564 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-238f4453-ef4d-4ed1-bad5-772b0f62af7d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1144 microversion: 2.1 time: 0.111460 May 19 12:34:14.102176 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 592/1236] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:13 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1144 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:14.562206 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a5d27a66-f9ca-466a-9780-70a26acbab8b tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:14.562828 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a5d27a66-f9ca-466a-9780-70a26acbab8b tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:14.569947 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a5d27a66-f9ca-466a-9780-70a26acbab8b tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:14.570465 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a5d27a66-f9ca-466a-9780-70a26acbab8b tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:14.571423 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a5d27a66-f9ca-466a-9780-70a26acbab8b tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:14.571997 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a5d27a66-f9ca-466a-9780-70a26acbab8b tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:14.716020 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a5d27a66-f9ca-466a-9780-70a26acbab8b tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:14.724163 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a5d27a66-f9ca-466a-9780-70a26acbab8b tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 200 len: 1318 microversion: 2.1 time: 0.166197 May 19 12:34:14.724758 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 645/1237] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:14 2022] GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:15.120460 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9071a714-baf2-4484-9c1d-1c64621b4c90 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:15.121231 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9071a714-baf2-4484-9c1d-1c64621b4c90 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:15.128922 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9071a714-baf2-4484-9c1d-1c64621b4c90 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:15.129511 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9071a714-baf2-4484-9c1d-1c64621b4c90 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:15.130832 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9071a714-baf2-4484-9c1d-1c64621b4c90 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:15.131623 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9071a714-baf2-4484-9c1d-1c64621b4c90 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:15.231489 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9071a714-baf2-4484-9c1d-1c64621b4c90 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:15.239811 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9071a714-baf2-4484-9c1d-1c64621b4c90 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1200 microversion: 2.1 time: 0.123767 May 19 12:34:15.240424 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 593/1238] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:15 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1200 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:15.753000 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-20c52cde-fcd4-4ddd-bd66-38f6dbb53b70 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:15.753578 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-20c52cde-fcd4-4ddd-bd66-38f6dbb53b70 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:15.762040 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-20c52cde-fcd4-4ddd-bd66-38f6dbb53b70 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:15.762655 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-20c52cde-fcd4-4ddd-bd66-38f6dbb53b70 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:15.763452 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-20c52cde-fcd4-4ddd-bd66-38f6dbb53b70 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:15.763915 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-20c52cde-fcd4-4ddd-bd66-38f6dbb53b70 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:15.924186 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-1d4771b7-1ac8-416c-8fec-2a4ac635721f req-dbb4ab24-9f3c-47bb-9d35-497d31340a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab3f86a-d962-4614-b0ab-e29e6683c6dd", "name": "network-vif-plugged", "status": "completed", "tag": "e18e084c-caa5-44c4-9d89-b500c9b8fc96"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:15.961083 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-1d4771b7-1ac8-416c-8fec-2a4ac635721f req-dbb4ab24-9f3c-47bb-9d35-497d31340a1e service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:15.962586 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-1d4771b7-1ac8-416c-8fec-2a4ac635721f req-dbb4ab24-9f3c-47bb-9d35-497d31340a1e service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:15.979527 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-20c52cde-fcd4-4ddd-bd66-38f6dbb53b70 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:15.983214 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-1d4771b7-1ac8-416c-8fec-2a4ac635721f req-dbb4ab24-9f3c-47bb-9d35-497d31340a1e service nova] Creating event network-vif-plugged:e18e084c-caa5-44c4-9d89-b500c9b8fc96 for instance dab3f86a-d962-4614-b0ab-e29e6683c6dd on hv-cinder-80475 May 19 12:34:15.989181 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-1d4771b7-1ac8-416c-8fec-2a4ac635721f req-dbb4ab24-9f3c-47bb-9d35-497d31340a1e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073916 May 19 12:34:15.989656 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-20c52cde-fcd4-4ddd-bd66-38f6dbb53b70 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 200 len: 1318 microversion: 2.1 time: 0.240551 May 19 12:34:15.989895 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 594/1239] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:34:15.992736 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 646/1240] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:15 2022] GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:16.259739 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f004be72-1cbb-4dbe-8ab2-2921389b9015 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:16.260504 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f004be72-1cbb-4dbe-8ab2-2921389b9015 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:16.268297 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f004be72-1cbb-4dbe-8ab2-2921389b9015 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:16.268777 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f004be72-1cbb-4dbe-8ab2-2921389b9015 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:16.269603 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f004be72-1cbb-4dbe-8ab2-2921389b9015 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:16.270056 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f004be72-1cbb-4dbe-8ab2-2921389b9015 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:16.465018 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f004be72-1cbb-4dbe-8ab2-2921389b9015 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:16.475907 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f004be72-1cbb-4dbe-8ab2-2921389b9015 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1277 microversion: 2.1 time: 0.220503 May 19 12:34:16.477296 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 595/1241] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:16 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1277 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:17.022239 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-76f9b97e-fa07-4a73-8daa-7de3f40ffee7 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:17.024522 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-76f9b97e-fa07-4a73-8daa-7de3f40ffee7 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:17.036539 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-76f9b97e-fa07-4a73-8daa-7de3f40ffee7 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:17.037439 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-76f9b97e-fa07-4a73-8daa-7de3f40ffee7 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:17.038358 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-76f9b97e-fa07-4a73-8daa-7de3f40ffee7 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:17.038984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-76f9b97e-fa07-4a73-8daa-7de3f40ffee7 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:17.297240 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-76f9b97e-fa07-4a73-8daa-7de3f40ffee7 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:17.297240 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-76f9b97e-fa07-4a73-8daa-7de3f40ffee7 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 200 len: 1318 microversion: 2.1 time: 0.280811 May 19 12:34:17.297240 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 647/1242] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:17 2022] GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:17.417495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-8380744b-a3a1-493f-86b5-5dcb77354b1b req-7d926a75-6ec5-4bf6-bdc2-048e8d8579f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0599acd8-409c-46f7-a162-3741afb80acc", "tag": "cb0adc2a-3045-4022-aea2-354ae0872cba"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:17.427495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-8380744b-a3a1-493f-86b5-5dcb77354b1b req-7d926a75-6ec5-4bf6-bdc2-048e8d8579f7 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:17.427986 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-8380744b-a3a1-493f-86b5-5dcb77354b1b req-7d926a75-6ec5-4bf6-bdc2-048e8d8579f7 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:17.441430 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-8380744b-a3a1-493f-86b5-5dcb77354b1b req-7d926a75-6ec5-4bf6-bdc2-048e8d8579f7 service nova] Creating event network-changed:cb0adc2a-3045-4022-aea2-354ae0872cba for instance 0599acd8-409c-46f7-a162-3741afb80acc on hv-cinder-80475 May 19 12:34:17.453709 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-8380744b-a3a1-493f-86b5-5dcb77354b1b req-7d926a75-6ec5-4bf6-bdc2-048e8d8579f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040282 May 19 12:34:17.454339 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 596/1243] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:34:17.512075 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-17531803-b5ce-4464-91d5-65505c5cfd22 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:17.513646 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-17531803-b5ce-4464-91d5-65505c5cfd22 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:17.526341 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17531803-b5ce-4464-91d5-65505c5cfd22 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:17.527694 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17531803-b5ce-4464-91d5-65505c5cfd22 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:17.528947 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17531803-b5ce-4464-91d5-65505c5cfd22 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:17.529658 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17531803-b5ce-4464-91d5-65505c5cfd22 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:17.754979 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-17531803-b5ce-4464-91d5-65505c5cfd22 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:17.764096 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-17531803-b5ce-4464-91d5-65505c5cfd22 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1277 microversion: 2.1 time: 0.262251 May 19 12:34:17.768581 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 648/1244] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:17 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1277 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:18.314326 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-dfe64953-b11e-47c9-9d9a-180f536c5d68 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:18.315059 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-dfe64953-b11e-47c9-9d9a-180f536c5d68 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:18.323347 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dfe64953-b11e-47c9-9d9a-180f536c5d68 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:18.323820 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dfe64953-b11e-47c9-9d9a-180f536c5d68 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:18.325915 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dfe64953-b11e-47c9-9d9a-180f536c5d68 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:18.325915 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-dfe64953-b11e-47c9-9d9a-180f536c5d68 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:18.503308 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-dfe64953-b11e-47c9-9d9a-180f536c5d68 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:18.519945 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-dfe64953-b11e-47c9-9d9a-180f536c5d68 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 200 len: 1318 microversion: 2.1 time: 0.209892 May 19 12:34:18.521216 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 597/1245] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:18 2022] GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:18.784506 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-691fad0d-0d97-4706-9e54-1477225d4c85 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:18.785625 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-691fad0d-0d97-4706-9e54-1477225d4c85 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:18.797610 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-691fad0d-0d97-4706-9e54-1477225d4c85 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:18.798410 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-691fad0d-0d97-4706-9e54-1477225d4c85 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:18.799527 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-691fad0d-0d97-4706-9e54-1477225d4c85 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:18.800359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-691fad0d-0d97-4706-9e54-1477225d4c85 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:18.995567 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-691fad0d-0d97-4706-9e54-1477225d4c85 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:19.003948 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-691fad0d-0d97-4706-9e54-1477225d4c85 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.223961 May 19 12:34:19.004552 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 649/1246] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:18 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:19.542983 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0004a91c-a009-40b2-820b-9496eb3b2b5a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:19.543812 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0004a91c-a009-40b2-820b-9496eb3b2b5a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:19.550577 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0004a91c-a009-40b2-820b-9496eb3b2b5a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:19.551091 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0004a91c-a009-40b2-820b-9496eb3b2b5a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:19.551972 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0004a91c-a009-40b2-820b-9496eb3b2b5a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:19.552411 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0004a91c-a009-40b2-820b-9496eb3b2b5a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:19.698583 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-0004a91c-a009-40b2-820b-9496eb3b2b5a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:19.709841 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0004a91c-a009-40b2-820b-9496eb3b2b5a tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 200 len: 1507 microversion: 2.1 time: 0.172019 May 19 12:34:19.710887 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 598/1247] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:19 2022] GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:19.732078 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-adff36e4-6489-402f-90e5-88c6847d30c0 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c7672fc-0bb3-4bae-b6c5-087123c1b61d", "device": "/dev/sdb"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:19.733307 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-adff36e4-6489-402f-90e5-88c6847d30c0 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:19.740202 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-adff36e4-6489-402f-90e5-88c6847d30c0 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:19.741018 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-adff36e4-6489-402f-90e5-88c6847d30c0 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:19.742382 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-adff36e4-6489-402f-90e5-88c6847d30c0 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:19.743149 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-adff36e4-6489-402f-90e5-88c6847d30c0 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:20.021396 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-5c0d50a2-3c98-4abc-b453-2726fbf367c2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:20.022293 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-5c0d50a2-3c98-4abc-b453-2726fbf367c2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:20.029629 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5c0d50a2-3c98-4abc-b453-2726fbf367c2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:20.030073 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5c0d50a2-3c98-4abc-b453-2726fbf367c2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:20.030850 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5c0d50a2-3c98-4abc-b453-2726fbf367c2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:20.031283 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-5c0d50a2-3c98-4abc-b453-2726fbf367c2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:20.209229 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-5c0d50a2-3c98-4abc-b453-2726fbf367c2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:20.217759 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-5c0d50a2-3c98-4abc-b453-2726fbf367c2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.200212 May 19 12:34:20.218335 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 599/1248] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:20 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:20.767028 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-adff36e4-6489-402f-90e5-88c6847d30c0 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "POST /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.043269 May 19 12:34:20.767685 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 650/1249] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 19 12:34:19 2022] POST /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd/os-volume_attachments => generated 194 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:34:21.235109 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-46817a36-2bc0-4a53-8107-00192f07f2de tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:21.235775 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-46817a36-2bc0-4a53-8107-00192f07f2de tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:21.242945 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-46817a36-2bc0-4a53-8107-00192f07f2de tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:21.243742 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-46817a36-2bc0-4a53-8107-00192f07f2de tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:21.244560 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-46817a36-2bc0-4a53-8107-00192f07f2de tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:21.245007 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-46817a36-2bc0-4a53-8107-00192f07f2de tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:21.385703 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-46817a36-2bc0-4a53-8107-00192f07f2de tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:21.394156 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-46817a36-2bc0-4a53-8107-00192f07f2de tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.162975 May 19 12:34:21.394916 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 600/1250] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:21 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:22.411033 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:22.412102 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=8 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:22.417726 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2c1b80f1-c500-4917-b2c7-826f5dd534c2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:22.418459 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2c1b80f1-c500-4917-b2c7-826f5dd534c2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:22.425635 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2c1b80f1-c500-4917-b2c7-826f5dd534c2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:22.426098 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2c1b80f1-c500-4917-b2c7-826f5dd534c2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:22.426893 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2c1b80f1-c500-4917-b2c7-826f5dd534c2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:22.427331 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2c1b80f1-c500-4917-b2c7-826f5dd534c2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:22.586499 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2c1b80f1-c500-4917-b2c7-826f5dd534c2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:22.596275 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2c1b80f1-c500-4917-b2c7-826f5dd534c2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.185997 May 19 12:34:22.596880 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 651/1251] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:22 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:23.613936 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9d00dc24-843c-4006-b47a-150de5705cee tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:23.614607 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9d00dc24-843c-4006-b47a-150de5705cee tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:23.617429 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell0:SELECT=12 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:23.623591 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9d00dc24-843c-4006-b47a-150de5705cee tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:23.624222 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9d00dc24-843c-4006-b47a-150de5705cee tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:23.632173 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9d00dc24-843c-4006-b47a-150de5705cee tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:23.632173 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9d00dc24-843c-4006-b47a-150de5705cee tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:23.800084 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9d00dc24-843c-4006-b47a-150de5705cee tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:23.808825 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9d00dc24-843c-4006-b47a-150de5705cee tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.198711 May 19 12:34:23.809428 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 601/1252] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:23 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:24.826410 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6175faf9-8644-436a-b715-451694372cf7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:24.827024 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6175faf9-8644-436a-b715-451694372cf7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:24.834687 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6175faf9-8644-436a-b715-451694372cf7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:24.835141 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6175faf9-8644-436a-b715-451694372cf7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:24.836060 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6175faf9-8644-436a-b715-451694372cf7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:24.836604 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6175faf9-8644-436a-b715-451694372cf7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:25.006841 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6175faf9-8644-436a-b715-451694372cf7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:25.015702 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6175faf9-8644-436a-b715-451694372cf7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.193035 May 19 12:34:25.016355 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 652/1253] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:24 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:26.033684 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-92a532e1-fb2c-41c5-842c-0d512070ba27 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:26.034390 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-92a532e1-fb2c-41c5-842c-0d512070ba27 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:26.042454 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-92a532e1-fb2c-41c5-842c-0d512070ba27 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:26.042902 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-92a532e1-fb2c-41c5-842c-0d512070ba27 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:26.043812 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-92a532e1-fb2c-41c5-842c-0d512070ba27 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:26.044244 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-92a532e1-fb2c-41c5-842c-0d512070ba27 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:26.203422 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-92a532e1-fb2c-41c5-842c-0d512070ba27 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:26.212760 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-92a532e1-fb2c-41c5-842c-0d512070ba27 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.182817 May 19 12:34:26.213989 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 602/1254] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:26 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:27.231161 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9e0d0727-5e03-40be-a1f2-18f1d5a9fdbf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:27.231868 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9e0d0727-5e03-40be-a1f2-18f1d5a9fdbf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:27.239011 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9e0d0727-5e03-40be-a1f2-18f1d5a9fdbf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:27.239611 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9e0d0727-5e03-40be-a1f2-18f1d5a9fdbf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:27.240440 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9e0d0727-5e03-40be-a1f2-18f1d5a9fdbf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:27.240885 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9e0d0727-5e03-40be-a1f2-18f1d5a9fdbf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:27.405135 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9e0d0727-5e03-40be-a1f2-18f1d5a9fdbf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:27.413341 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9e0d0727-5e03-40be-a1f2-18f1d5a9fdbf tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.186424 May 19 12:34:27.416190 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 653/1255] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:27 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:28.442108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-8d8d5154-fbbd-4c2a-9551-c3d12e1ffd5d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:28.443142 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-8d8d5154-fbbd-4c2a-9551-c3d12e1ffd5d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:28.457994 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8d8d5154-fbbd-4c2a-9551-c3d12e1ffd5d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:28.458790 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8d8d5154-fbbd-4c2a-9551-c3d12e1ffd5d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:28.460506 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8d8d5154-fbbd-4c2a-9551-c3d12e1ffd5d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:28.461238 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8d8d5154-fbbd-4c2a-9551-c3d12e1ffd5d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:28.696451 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-8d8d5154-fbbd-4c2a-9551-c3d12e1ffd5d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:28.712703 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-8d8d5154-fbbd-4c2a-9551-c3d12e1ffd5d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.274123 May 19 12:34:28.713712 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 603/1256] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:28 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:29.735413 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7dd1daf2-3c14-4f63-a201-1fc30e53feae tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:29.736339 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7dd1daf2-3c14-4f63-a201-1fc30e53feae tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:29.747094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7dd1daf2-3c14-4f63-a201-1fc30e53feae tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:29.747547 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7dd1daf2-3c14-4f63-a201-1fc30e53feae tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:29.748413 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7dd1daf2-3c14-4f63-a201-1fc30e53feae tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:29.748877 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7dd1daf2-3c14-4f63-a201-1fc30e53feae tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:29.920395 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7dd1daf2-3c14-4f63-a201-1fc30e53feae tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:29.929714 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7dd1daf2-3c14-4f63-a201-1fc30e53feae tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.198023 May 19 12:34:29.932170 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 654/1257] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:29 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:30.956826 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9545e97f-8d4a-4a25-84ac-43dca4751308 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:30.957546 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9545e97f-8d4a-4a25-84ac-43dca4751308 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:30.966888 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9545e97f-8d4a-4a25-84ac-43dca4751308 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:30.967335 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9545e97f-8d4a-4a25-84ac-43dca4751308 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:30.968179 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9545e97f-8d4a-4a25-84ac-43dca4751308 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:30.968619 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9545e97f-8d4a-4a25-84ac-43dca4751308 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:31.123834 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9545e97f-8d4a-4a25-84ac-43dca4751308 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:31.132135 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9545e97f-8d4a-4a25-84ac-43dca4751308 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.179161 May 19 12:34:31.132759 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 604/1258] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:30 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:32.152106 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-057441f0-44cf-48d1-a062-eb925cc53cb1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:32.152796 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-057441f0-44cf-48d1-a062-eb925cc53cb1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:32.159763 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-057441f0-44cf-48d1-a062-eb925cc53cb1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:32.160267 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-057441f0-44cf-48d1-a062-eb925cc53cb1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:32.161142 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-057441f0-44cf-48d1-a062-eb925cc53cb1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:32.161580 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-057441f0-44cf-48d1-a062-eb925cc53cb1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:32.186027 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:32.325104 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-057441f0-44cf-48d1-a062-eb925cc53cb1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:32.333698 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-057441f0-44cf-48d1-a062-eb925cc53cb1 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.186667 May 19 12:34:32.334309 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 655/1259] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:32 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:33.353419 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6f49c3d4-e2a9-4f97-b3cf-e28f1ec103a5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:33.354268 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6f49c3d4-e2a9-4f97-b3cf-e28f1ec103a5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:33.356466 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:33.361499 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6f49c3d4-e2a9-4f97-b3cf-e28f1ec103a5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:33.361954 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6f49c3d4-e2a9-4f97-b3cf-e28f1ec103a5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:33.362749 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6f49c3d4-e2a9-4f97-b3cf-e28f1ec103a5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:33.363186 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6f49c3d4-e2a9-4f97-b3cf-e28f1ec103a5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:33.529933 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6f49c3d4-e2a9-4f97-b3cf-e28f1ec103a5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:33.532630 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=95 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:33.539567 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6f49c3d4-e2a9-4f97-b3cf-e28f1ec103a5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.191018 May 19 12:34:33.541036 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 605/1260] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:33 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:34.558369 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1d28f64f-1834-4f0d-b11d-1812b2ba0073 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:34.559130 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1d28f64f-1834-4f0d-b11d-1812b2ba0073 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:34.567124 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1d28f64f-1834-4f0d-b11d-1812b2ba0073 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:34.567626 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1d28f64f-1834-4f0d-b11d-1812b2ba0073 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:34.568575 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1d28f64f-1834-4f0d-b11d-1812b2ba0073 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:34.569054 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1d28f64f-1834-4f0d-b11d-1812b2ba0073 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:34.732465 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1d28f64f-1834-4f0d-b11d-1812b2ba0073 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:34.741011 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1d28f64f-1834-4f0d-b11d-1812b2ba0073 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.187325 May 19 12:34:34.742075 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 656/1261] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:34 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:35.708494 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-cf16343d-cb85-42e8-b47b-c5ca685d0489 req-3e16c836-061e-46ca-a1c5-6328306140e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0599acd8-409c-46f7-a162-3741afb80acc", "name": "network-vif-plugged", "status": "completed", "tag": "cb0adc2a-3045-4022-aea2-354ae0872cba"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:35.718880 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-cf16343d-cb85-42e8-b47b-c5ca685d0489 req-3e16c836-061e-46ca-a1c5-6328306140e0 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:35.719338 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-cf16343d-cb85-42e8-b47b-c5ca685d0489 req-3e16c836-061e-46ca-a1c5-6328306140e0 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:35.732196 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-cf16343d-cb85-42e8-b47b-c5ca685d0489 req-3e16c836-061e-46ca-a1c5-6328306140e0 service nova] Creating event network-vif-plugged:cb0adc2a-3045-4022-aea2-354ae0872cba for instance 0599acd8-409c-46f7-a162-3741afb80acc on hv-cinder-80475 May 19 12:34:35.737589 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-cf16343d-cb85-42e8-b47b-c5ca685d0489 req-3e16c836-061e-46ca-a1c5-6328306140e0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130764 May 19 12:34:35.738531 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 606/1262] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:34:35.761903 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-da66980b-2934-4261-8fe8-141a0a6205a7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:35.762908 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-da66980b-2934-4261-8fe8-141a0a6205a7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:35.771433 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-da66980b-2934-4261-8fe8-141a0a6205a7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:35.773816 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-da66980b-2934-4261-8fe8-141a0a6205a7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:35.773816 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-da66980b-2934-4261-8fe8-141a0a6205a7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:35.773816 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-da66980b-2934-4261-8fe8-141a0a6205a7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:35.936007 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-da66980b-2934-4261-8fe8-141a0a6205a7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:35.949013 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-da66980b-2934-4261-8fe8-141a0a6205a7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.192590 May 19 12:34:35.950943 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 657/1263] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:35 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:36.970165 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0707d1e1-7c7f-487a-89b6-bfb7b8f3d6a2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:36.975025 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0707d1e1-7c7f-487a-89b6-bfb7b8f3d6a2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:36.978792 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0707d1e1-7c7f-487a-89b6-bfb7b8f3d6a2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:36.979254 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0707d1e1-7c7f-487a-89b6-bfb7b8f3d6a2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:36.980077 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0707d1e1-7c7f-487a-89b6-bfb7b8f3d6a2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:36.980520 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0707d1e1-7c7f-487a-89b6-bfb7b8f3d6a2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:37.156206 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-0707d1e1-7c7f-487a-89b6-bfb7b8f3d6a2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:37.165444 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0707d1e1-7c7f-487a-89b6-bfb7b8f3d6a2 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.199606 May 19 12:34:37.166101 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 607/1264] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:36 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:38.190248 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4d633a76-f47e-4e45-a96b-0189eb93ebb4 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:38.190902 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4d633a76-f47e-4e45-a96b-0189eb93ebb4 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:38.193584 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:38.199524 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4d633a76-f47e-4e45-a96b-0189eb93ebb4 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:38.208806 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4d633a76-f47e-4e45-a96b-0189eb93ebb4 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:38.208806 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4d633a76-f47e-4e45-a96b-0189eb93ebb4 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:38.208806 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4d633a76-f47e-4e45-a96b-0189eb93ebb4 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:38.349427 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4d633a76-f47e-4e45-a96b-0189eb93ebb4 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:38.358515 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4d633a76-f47e-4e45-a96b-0189eb93ebb4 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.172320 May 19 12:34:38.359107 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 658/1265] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:38 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:39.376382 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a5c2fe9c-6b06-415a-abde-a0a92b4f203c tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:39.377011 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a5c2fe9c-6b06-415a-abde-a0a92b4f203c tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:39.384746 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a5c2fe9c-6b06-415a-abde-a0a92b4f203c tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:39.385190 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a5c2fe9c-6b06-415a-abde-a0a92b4f203c tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:39.385980 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a5c2fe9c-6b06-415a-abde-a0a92b4f203c tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:39.386408 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a5c2fe9c-6b06-415a-abde-a0a92b4f203c tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:39.549642 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a5c2fe9c-6b06-415a-abde-a0a92b4f203c tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:39.557543 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a5c2fe9c-6b06-415a-abde-a0a92b4f203c tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.185230 May 19 12:34:39.558144 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 608/1266] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:39 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:40.575115 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6533fa2a-eafe-4ad2-9718-7d7b4faf2e20 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:40.575851 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6533fa2a-eafe-4ad2-9718-7d7b4faf2e20 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:40.583006 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6533fa2a-eafe-4ad2-9718-7d7b4faf2e20 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:40.583503 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6533fa2a-eafe-4ad2-9718-7d7b4faf2e20 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:40.584392 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6533fa2a-eafe-4ad2-9718-7d7b4faf2e20 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:40.584871 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6533fa2a-eafe-4ad2-9718-7d7b4faf2e20 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:40.751113 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6533fa2a-eafe-4ad2-9718-7d7b4faf2e20 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:40.760131 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6533fa2a-eafe-4ad2-9718-7d7b4faf2e20 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.189153 May 19 12:34:40.761121 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 659/1267] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:40 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:41.777714 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-0a3cbe0f-03e7-4109-831f-89d1b904b829 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:41.778616 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-0a3cbe0f-03e7-4109-831f-89d1b904b829 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:41.785891 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0a3cbe0f-03e7-4109-831f-89d1b904b829 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:41.786299 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0a3cbe0f-03e7-4109-831f-89d1b904b829 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:41.787069 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0a3cbe0f-03e7-4109-831f-89d1b904b829 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:41.787502 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-0a3cbe0f-03e7-4109-831f-89d1b904b829 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:41.965365 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-0a3cbe0f-03e7-4109-831f-89d1b904b829 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:41.973729 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-0a3cbe0f-03e7-4109-831f-89d1b904b829 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1265 microversion: 2.1 time: 0.200129 May 19 12:34:41.974314 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 609/1268] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:41 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:42.992282 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0176c272-0ef3-42bc-94a7-6e0aa3610b64 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:42.993669 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0176c272-0ef3-42bc-94a7-6e0aa3610b64 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:43.000131 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0176c272-0ef3-42bc-94a7-6e0aa3610b64 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:43.004296 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0176c272-0ef3-42bc-94a7-6e0aa3610b64 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:43.004296 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0176c272-0ef3-42bc-94a7-6e0aa3610b64 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:43.004296 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0176c272-0ef3-42bc-94a7-6e0aa3610b64 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:43.146431 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0176c272-0ef3-42bc-94a7-6e0aa3610b64 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:43.154916 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0176c272-0ef3-42bc-94a7-6e0aa3610b64 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1452 microversion: 2.1 time: 0.166866 May 19 12:34:43.155491 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 660/1269] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:42 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:43.172580 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-a2267b4d-2529-43ce-927c-54fba9a5ab4e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:43.173265 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-a2267b4d-2529-43ce-927c-54fba9a5ab4e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:43.180342 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a2267b4d-2529-43ce-927c-54fba9a5ab4e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:43.181289 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a2267b4d-2529-43ce-927c-54fba9a5ab4e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:43.182069 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a2267b4d-2529-43ce-927c-54fba9a5ab4e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:43.182497 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-a2267b4d-2529-43ce-927c-54fba9a5ab4e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:43.331121 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-a2267b4d-2529-43ce-927c-54fba9a5ab4e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:43.341059 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-a2267b4d-2529-43ce-927c-54fba9a5ab4e tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1452 microversion: 2.1 time: 0.172154 May 19 12:34:43.341563 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 610/1270] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:43 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:46.350622 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-22e7b31b-1ac3-4ada-b537-bb838ebede15 req-cf04000b-afdb-4ed1-9e61-7ffdddda8f62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0599acd8-409c-46f7-a162-3741afb80acc", "tag": "cb0adc2a-3045-4022-aea2-354ae0872cba"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:46.359980 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-22e7b31b-1ac3-4ada-b537-bb838ebede15 req-cf04000b-afdb-4ed1-9e61-7ffdddda8f62 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:46.360423 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-22e7b31b-1ac3-4ada-b537-bb838ebede15 req-cf04000b-afdb-4ed1-9e61-7ffdddda8f62 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:46.376212 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-22e7b31b-1ac3-4ada-b537-bb838ebede15 req-cf04000b-afdb-4ed1-9e61-7ffdddda8f62 service nova] Creating event network-changed:cb0adc2a-3045-4022-aea2-354ae0872cba for instance 0599acd8-409c-46f7-a162-3741afb80acc on hv-cinder-80475 May 19 12:34:46.382654 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-22e7b31b-1ac3-4ada-b537-bb838ebede15 req-cf04000b-afdb-4ed1-9e61-7ffdddda8f62 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124753 May 19 12:34:46.384269 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 661/1271] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:34:47.677096 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f8be9657-fabb-44a6-8dcf-c4ae3fabf62e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:47.677709 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f8be9657-fabb-44a6-8dcf-c4ae3fabf62e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:47.685736 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f8be9657-fabb-44a6-8dcf-c4ae3fabf62e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:47.686333 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f8be9657-fabb-44a6-8dcf-c4ae3fabf62e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:47.687130 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f8be9657-fabb-44a6-8dcf-c4ae3fabf62e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:47.687582 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f8be9657-fabb-44a6-8dcf-c4ae3fabf62e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:47.778765 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.objects.instance [None req-f8be9657-fabb-44a6-8dcf-c4ae3fabf62e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lazy-loading 'services' on Instance uuid dab3f86a-d962-4614-b0ab-e29e6683c6dd {{(pid=117964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:34:48.090833 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f8be9657-fabb-44a6-8dcf-c4ae3fabf62e tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd/os-volume_attachments/9c7672fc-0bb3-4bae-b6c5-087123c1b61d" status: 202 len: 0 microversion: 2.1 time: 0.417586 May 19 12:34:48.091565 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 611/1272] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 19 12:34:47 2022] DELETE /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd/os-volume_attachments/9c7672fc-0bb3-4bae-b6c5-087123c1b61d => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:34:50.286081 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-48ce5447-2231-41ab-9a48-955ddc6afe2f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:50.286752 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-48ce5447-2231-41ab-9a48-955ddc6afe2f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:50.295190 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-48ce5447-2231-41ab-9a48-955ddc6afe2f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:50.295656 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-48ce5447-2231-41ab-9a48-955ddc6afe2f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:50.296528 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-48ce5447-2231-41ab-9a48-955ddc6afe2f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:50.296984 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-48ce5447-2231-41ab-9a48-955ddc6afe2f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:50.329078 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-48ce5447-2231-41ab-9a48-955ddc6afe2f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:34:50.725321 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-48ce5447-2231-41ab-9a48-955ddc6afe2f tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 204 len: 0 microversion: 2.1 time: 0.444007 May 19 12:34:50.725915 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 662/1273] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:34:50 2022] DELETE /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 12:34:50.735863 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-6eb78836-3cc9-4708-9e96-0867fe1343a1 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:50.736717 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-6eb78836-3cc9-4708-9e96-0867fe1343a1 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:50.744219 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6eb78836-3cc9-4708-9e96-0867fe1343a1 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:50.744668 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6eb78836-3cc9-4708-9e96-0867fe1343a1 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:50.745442 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6eb78836-3cc9-4708-9e96-0867fe1343a1 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:50.745878 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-6eb78836-3cc9-4708-9e96-0867fe1343a1 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:50.885453 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-6eb78836-3cc9-4708-9e96-0867fe1343a1 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:50.893650 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-6eb78836-3cc9-4708-9e96-0867fe1343a1 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 200 len: 1513 microversion: 2.1 time: 0.162456 May 19 12:34:50.904479 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 612/1274] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:50 2022] GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:51.913911 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-52ffe09b-d800-4d2f-afe6-dca983e6f3df tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:51.915569 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-52ffe09b-d800-4d2f-afe6-dca983e6f3df tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:51.923252 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-52ffe09b-d800-4d2f-afe6-dca983e6f3df tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:51.923704 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-52ffe09b-d800-4d2f-afe6-dca983e6f3df tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:51.924531 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-52ffe09b-d800-4d2f-afe6-dca983e6f3df tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:51.924964 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-52ffe09b-d800-4d2f-afe6-dca983e6f3df tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:52.094180 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-52ffe09b-d800-4d2f-afe6-dca983e6f3df tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:52.106253 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-52ffe09b-d800-4d2f-afe6-dca983e6f3df tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 200 len: 1513 microversion: 2.1 time: 0.197431 May 19 12:34:52.106762 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 663/1275] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:51 2022] GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:53.125833 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-f3065df0-b5aa-4ac7-85bb-02f88c7fa537 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:53.126608 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-f3065df0-b5aa-4ac7-85bb-02f88c7fa537 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:53.135870 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f3065df0-b5aa-4ac7-85bb-02f88c7fa537 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:53.136321 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f3065df0-b5aa-4ac7-85bb-02f88c7fa537 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:53.137164 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f3065df0-b5aa-4ac7-85bb-02f88c7fa537 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:53.137615 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-f3065df0-b5aa-4ac7-85bb-02f88c7fa537 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:53.303832 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-f3065df0-b5aa-4ac7-85bb-02f88c7fa537 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:53.315860 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-f3065df0-b5aa-4ac7-85bb-02f88c7fa537 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 200 len: 1513 microversion: 2.1 time: 0.193038 May 19 12:34:53.315860 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 613/1276] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:53 2022] GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:54.077417 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-7e15d69f-01ec-42a2-a74b-6a68369c1e72 req-3fcb5902-0dec-469b-97f1-dc0da1bfbfd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab3f86a-d962-4614-b0ab-e29e6683c6dd", "name": "network-vif-deleted", "tag": "e18e084c-caa5-44c4-9d89-b500c9b8fc96"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:54.098907 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-7e15d69f-01ec-42a2-a74b-6a68369c1e72 req-3fcb5902-0dec-469b-97f1-dc0da1bfbfd0 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:54.099700 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-7e15d69f-01ec-42a2-a74b-6a68369c1e72 req-3fcb5902-0dec-469b-97f1-dc0da1bfbfd0 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:54.127457 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-7e15d69f-01ec-42a2-a74b-6a68369c1e72 req-3fcb5902-0dec-469b-97f1-dc0da1bfbfd0 service nova] Creating event network-vif-deleted:e18e084c-caa5-44c4-9d89-b500c9b8fc96 for instance dab3f86a-d962-4614-b0ab-e29e6683c6dd on hv-cinder-80475 May 19 12:34:54.133041 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-7e15d69f-01ec-42a2-a74b-6a68369c1e72 req-3fcb5902-0dec-469b-97f1-dc0da1bfbfd0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063520 May 19 12:34:54.135230 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 664/1277] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:34:54.340352 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-298b3a1a-dada-417b-a443-5b4c73614f22 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:54.340958 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-298b3a1a-dada-417b-a443-5b4c73614f22 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:54.348420 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-298b3a1a-dada-417b-a443-5b4c73614f22 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:54.348879 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-298b3a1a-dada-417b-a443-5b4c73614f22 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:54.357425 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-298b3a1a-dada-417b-a443-5b4c73614f22 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:54.358002 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-298b3a1a-dada-417b-a443-5b4c73614f22 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:54.442138 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-298b3a1a-dada-417b-a443-5b4c73614f22 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f901fc3ba9b24c39a252aa5a7c9d431c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b15da1cdfb45c88bb7827e650d33c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:54.452295 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-298b3a1a-dada-417b-a443-5b4c73614f22 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 200 len: 1303 microversion: 2.1 time: 0.116191 May 19 12:34:54.453223 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 614/1278] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:54 2022] GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 1303 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:55.472464 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7d96a4c2-c350-4fbc-b917-a7cb8624fa59 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:55.473380 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7d96a4c2-c350-4fbc-b917-a7cb8624fa59 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] [instance: dab3f86a-d962-4614-b0ab-e29e6683c6dd] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:55.480723 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7d96a4c2-c350-4fbc-b917-a7cb8624fa59 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:55.485111 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7d96a4c2-c350-4fbc-b917-a7cb8624fa59 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:55.485111 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7d96a4c2-c350-4fbc-b917-a7cb8624fa59 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:55.485111 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7d96a4c2-c350-4fbc-b917-a7cb8624fa59 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:55.498120 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-7d96a4c2-c350-4fbc-b917-a7cb8624fa59 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] HTTP exception thrown: Instance dab3f86a-d962-4614-b0ab-e29e6683c6dd could not be found. May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7d96a4c2-c350-4fbc-b917-a7cb8624fa59 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Request method failure captured: May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd HTTP/1.1 May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjjcpFMIT_sHr_abnliO10TGYcmu7cWZQ-urIEI1MsS2tgACUE5uOnN-Gc97SzbaQuDMZrmgijSz3WeJ6U0-5ySd8OW-P1yEBYmG1KxYQWp_PJrL-7UKAYPjJbdLa_Q0mctC5gCxJrU0K7foRb5faFR0qjVNazJ4qtSvhI4WDQaLJr4 May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: b0b15da1cdfb45c88bb7827e650d33c9 May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2107081936 May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:34:55.499960 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:34:55.502594 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b0b15da1cdfb45c88bb7827e650d33c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b0b15da1cdfb45c88bb7827e650d33c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b0b15da1cdfb45c88bb7827e650d33c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b0b15da1cdfb45c88bb7827e650d33c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:34:55.502594 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-VolumesSnapshotTestJSON-2107081936 May 19 12:34:55.502594 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: b0b15da1cdfb45c88bb7827e650d33c9 May 19 12:34:55.502594 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2107081936 May 19 12:34:55.502594 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-VolumesSnapshotTestJSON-2107081936-project May 19 12:34:55.502594 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:34:55.502594 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:34:55.502594 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: f901fc3ba9b24c39a252aa5a7c9d431c May 19 12:34:55.502594 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-VolumesSnapshotTestJSON-2107081936-project May 19 12:34:55.502594 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:34:55.502594 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance dab3f86a-d962-4614-b0ab-e29e6683c6dd could not be found. May 19 12:34:55.502594 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': 'dab3f86a-d962-4614-b0ab-e29e6683c6dd'} May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab3f86a-d962-4614-b0ab-e29e6683c6dd could not be found. May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:34:55.504314 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:34:55.507259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:34:55.507259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:34:55.507259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:34:55.507259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:34:55.507259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:34:55.507259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:34:55.507259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:34:55.507259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab3f86a-d962-4614-b0ab-e29e6683c6dd could not be found. May 19 12:34:55.507259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:34:55.507259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:34:55.507259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:34:55.507259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:55.507259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:34:55.507259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:34:55.507259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:34:55.507259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:34:55.507259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab3f86a-d962-4614-b0ab-e29e6683c6dd could not be found. May 19 12:34:55.507259 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:34:55.509832 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7d96a4c2-c350-4fbc-b917-a7cb8624fa59 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] Returning 404 to user: Instance dab3f86a-d962-4614-b0ab-e29e6683c6dd could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:34:55.509832 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7d96a4c2-c350-4fbc-b917-a7cb8624fa59 tempest-VolumesSnapshotTestJSON-2107081936 tempest-VolumesSnapshotTestJSON-2107081936-project] 10.222.0.23 "GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd" status: 404 len: 111 microversion: 2.1 time: 0.034403 May 19 12:34:55.509832 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 665/1279] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:34:55 2022] GET /compute/v2.1/servers/dab3f86a-d962-4614-b0ab-e29e6683c6dd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:36:16.269116 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:36:16.269889 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Thu May 19 12:36:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:36:30.125159 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:36:30.125964 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Thu May 19 12:36:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:36:34.442285 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:36:34.442953 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Thu May 19 12:36:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:36:50.570888 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:36:50.571679 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Thu May 19 12:36:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:37:02.209050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR oslo.messaging._drivers.impl_rabbit [-] [69f2b1dc-a8ac-4c79-ab51-b2d0b84d4230] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 12:37:02.209050 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_api:SELECT=19 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:37:02.209888 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG dbcounter [-] [117964] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=1 {{(pid=117964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:37:02.214170 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d6a049a8-2584-4888-8efd-492b15f7a4be] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 12:37:02.215849 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:37:02.216999 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:37:02.217255 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-b6783272-6316-4a38-8186-7fb6498ad319 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:02.217776 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-b6783272-6316-4a38-8186-7fb6498ad319 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:02.223242 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-8e8a79b9-2b84-4ebe-baf4-47059432b4dc req-62f11660-7ed7-4d64-9b81-969fb087319e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0599acd8-409c-46f7-a162-3741afb80acc", "tag": "cb0adc2a-3045-4022-aea2-354ae0872cba"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:37:02.224913 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b6783272-6316-4a38-8186-7fb6498ad319 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:02.225603 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b6783272-6316-4a38-8186-7fb6498ad319 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:02.227329 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b6783272-6316-4a38-8186-7fb6498ad319 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:02.228040 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-b6783272-6316-4a38-8186-7fb6498ad319 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:02.234266 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-8e8a79b9-2b84-4ebe-baf4-47059432b4dc req-62f11660-7ed7-4d64-9b81-969fb087319e service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:02.234713 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-8e8a79b9-2b84-4ebe-baf4-47059432b4dc req-62f11660-7ed7-4d64-9b81-969fb087319e service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:02.248246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-8e8a79b9-2b84-4ebe-baf4-47059432b4dc req-62f11660-7ed7-4d64-9b81-969fb087319e service nova] Creating event network-changed:cb0adc2a-3045-4022-aea2-354ae0872cba for instance 0599acd8-409c-46f7-a162-3741afb80acc on hv-cinder-80475 May 19 12:37:02.254789 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-8e8a79b9-2b84-4ebe-baf4-47059432b4dc req-62f11660-7ed7-4d64-9b81-969fb087319e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042844 May 19 12:37:02.255703 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 666/1280] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:37:02.262525 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-b6783272-6316-4a38-8186-7fb6498ad319 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Going to try to terminate instance {{(pid=117964) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:37:02.607320 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-b6783272-6316-4a38-8186-7fb6498ad319 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 204 len: 0 microversion: 2.1 time: 0.399302 May 19 12:37:02.609169 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 615/1281] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:37:02 2022] DELETE /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 12:37:02.624511 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5cd726cc-98d4-4b8c-a284-be0931301b55 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:02.626262 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5cd726cc-98d4-4b8c-a284-be0931301b55 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:02.640450 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5cd726cc-98d4-4b8c-a284-be0931301b55 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:02.641241 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5cd726cc-98d4-4b8c-a284-be0931301b55 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:02.642655 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5cd726cc-98d4-4b8c-a284-be0931301b55 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:02.643374 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5cd726cc-98d4-4b8c-a284-be0931301b55 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:02.853298 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5cd726cc-98d4-4b8c-a284-be0931301b55 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:02.864028 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5cd726cc-98d4-4b8c-a284-be0931301b55 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1577 microversion: 2.1 time: 0.249335 May 19 12:37:02.870707 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 667/1282] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:37:02 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1577 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:03.892978 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-50b8084d-99bd-4931-96ed-e3f5c76753c9 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:03.894308 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-50b8084d-99bd-4931-96ed-e3f5c76753c9 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:03.907051 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-50b8084d-99bd-4931-96ed-e3f5c76753c9 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:03.907628 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-50b8084d-99bd-4931-96ed-e3f5c76753c9 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:03.908539 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-50b8084d-99bd-4931-96ed-e3f5c76753c9 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:03.909096 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-50b8084d-99bd-4931-96ed-e3f5c76753c9 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:03.919834 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO oslo.messaging._drivers.impl_rabbit [-] [69f2b1dc-a8ac-4c79-ab51-b2d0b84d4230] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58828. May 19 12:37:04.073567 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-50b8084d-99bd-4931-96ed-e3f5c76753c9 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:04.081743 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-50b8084d-99bd-4931-96ed-e3f5c76753c9 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1577 microversion: 2.1 time: 0.197349 May 19 12:37:04.082341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 616/1283] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:37:03 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:05.105534 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7f38508a-abfe-4af1-8505-5ad5b5124f10 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:05.106621 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7f38508a-abfe-4af1-8505-5ad5b5124f10 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:05.126494 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7f38508a-abfe-4af1-8505-5ad5b5124f10 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:05.127549 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7f38508a-abfe-4af1-8505-5ad5b5124f10 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:05.128514 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7f38508a-abfe-4af1-8505-5ad5b5124f10 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:05.128955 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7f38508a-abfe-4af1-8505-5ad5b5124f10 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:05.139115 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO oslo.messaging._drivers.impl_rabbit [-] [d6a049a8-2584-4888-8efd-492b15f7a4be] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58832. May 19 12:37:05.260257 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7f38508a-abfe-4af1-8505-5ad5b5124f10 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:05.276679 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7f38508a-abfe-4af1-8505-5ad5b5124f10 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1391 microversion: 2.1 time: 0.178905 May 19 12:37:05.277664 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 668/1284] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:37:05 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:05.563074 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-f2cf3161-c247-4488-9b01-a8460b56aa92 req-fd15369e-2645-4096-990e-da93f6b6c5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0599acd8-409c-46f7-a162-3741afb80acc", "name": "network-vif-deleted", "tag": "cb0adc2a-3045-4022-aea2-354ae0872cba"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:37:05.578861 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-f2cf3161-c247-4488-9b01-a8460b56aa92 req-fd15369e-2645-4096-990e-da93f6b6c5b3 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:05.579521 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-f2cf3161-c247-4488-9b01-a8460b56aa92 req-fd15369e-2645-4096-990e-da93f6b6c5b3 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:05.598211 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-f2cf3161-c247-4488-9b01-a8460b56aa92 req-fd15369e-2645-4096-990e-da93f6b6c5b3 service nova] Creating event network-vif-deleted:cb0adc2a-3045-4022-aea2-354ae0872cba for instance 0599acd8-409c-46f7-a162-3741afb80acc on hv-cinder-80475 May 19 12:37:05.604800 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-f2cf3161-c247-4488-9b01-a8460b56aa92 req-fd15369e-2645-4096-990e-da93f6b6c5b3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.359798 May 19 12:37:05.605633 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 617/1285] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:37:06.296738 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8e31702f-fbac-4fd5-8c0a-fb629b4e08ee tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:06.297855 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8e31702f-fbac-4fd5-8c0a-fb629b4e08ee tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:06.308113 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8e31702f-fbac-4fd5-8c0a-fb629b4e08ee tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:06.308709 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8e31702f-fbac-4fd5-8c0a-fb629b4e08ee tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:06.309620 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8e31702f-fbac-4fd5-8c0a-fb629b4e08ee tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:06.310171 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8e31702f-fbac-4fd5-8c0a-fb629b4e08ee tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:06.354528 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8e31702f-fbac-4fd5-8c0a-fb629b4e08ee tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:06.355076 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8e31702f-fbac-4fd5-8c0a-fb629b4e08ee tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:06.355685 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-8e31702f-fbac-4fd5-8c0a-fb629b4e08ee tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lazy-loading 'fault' on Instance uuid 0599acd8-409c-46f7-a162-3741afb80acc {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:37:06.410342 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8e31702f-fbac-4fd5-8c0a-fb629b4e08ee tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:06.425050 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8e31702f-fbac-4fd5-8c0a-fb629b4e08ee tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 200 len: 1230 microversion: 2.1 time: 0.132892 May 19 12:37:06.426157 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 669/1286] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:37:06 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 1230 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:07.454522 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-90321d3c-690b-491b-bc22-98a6a748fc3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:07.455432 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-90321d3c-690b-491b-bc22-98a6a748fc3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 0599acd8-409c-46f7-a162-3741afb80acc] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:07.463045 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-90321d3c-690b-491b-bc22-98a6a748fc3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:07.463802 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-90321d3c-690b-491b-bc22-98a6a748fc3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:07.464890 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-90321d3c-690b-491b-bc22-98a6a748fc3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:07.465591 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-90321d3c-690b-491b-bc22-98a6a748fc3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:07.481821 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-90321d3c-690b-491b-bc22-98a6a748fc3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] HTTP exception thrown: Instance 0599acd8-409c-46f7-a162-3741afb80acc could not be found. May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-90321d3c-690b-491b-bc22-98a6a748fc3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Request method failure captured: May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc HTTP/1.1 May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjeC2Em27PMp9Af2Y9rGUH2CGe7aXy_xBl2gaNgyc_fui5CRQJGgecuBicS5LhxjRGHyAdcG99UTAqjXcnhWRudO655qCHQ2_XKadQhcHqubtpN2Zh1FImipSVjvWb934hApgz0HundRUQITGibgYmIY7pTw3bDvFr9XflzI5ue9Sc4 May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 4b46044a7f1d471582800c9d8a79e5c5 May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-TestVolumeBootPattern-614865877 May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:37:07.483495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:37:07.486356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:37:07.486356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-TestVolumeBootPattern-614865877 May 19 12:37:07.486356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 4b46044a7f1d471582800c9d8a79e5c5 May 19 12:37:07.486356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-TestVolumeBootPattern-614865877 May 19 12:37:07.486356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-TestVolumeBootPattern-614865877-project May 19 12:37:07.486356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:37:07.486356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:37:07.486356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: 2d158b01a0a74de4bc0131b5c625efdf May 19 12:37:07.486356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-TestVolumeBootPattern-614865877-project May 19 12:37:07.486356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:37:07.486356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance 0599acd8-409c-46f7-a162-3741afb80acc could not be found. May 19 12:37:07.486356 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': '0599acd8-409c-46f7-a162-3741afb80acc'} May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0599acd8-409c-46f7-a162-3741afb80acc could not be found. May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:37:07.488349 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:37:07.493119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:37:07.493119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:37:07.493119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:37:07.493119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:37:07.493119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:37:07.493119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:37:07.493119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:37:07.493119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0599acd8-409c-46f7-a162-3741afb80acc could not be found. May 19 12:37:07.493119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:37:07.493119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:07.493119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:37:07.493119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:07.493119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:07.493119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:07.493119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:37:07.493119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:37:07.493119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0599acd8-409c-46f7-a162-3741afb80acc could not be found. May 19 12:37:07.493119 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:37:07.497906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-90321d3c-690b-491b-bc22-98a6a748fc3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Returning 404 to user: Instance 0599acd8-409c-46f7-a162-3741afb80acc could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:37:07.497906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-90321d3c-690b-491b-bc22-98a6a748fc3d tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc" status: 404 len: 111 microversion: 2.1 time: 0.036129 May 19 12:37:07.497906 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 618/1287] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:37:07 2022] GET /compute/v2.1/servers/0599acd8-409c-46f7-a162-3741afb80acc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:37:11.265032 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-055379a0-4346-432a-926a-aaf0fde30251 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:11.265651 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-055379a0-4346-432a-926a-aaf0fde30251 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:11.267959 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-7d68b9c4-63c7-4fe5-84b4-67c4d25aabd3 req-2641289c-1394-47da-9748-0b401168c753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ff53b5f-8422-468d-8c6c-48b571af4ab2", "tag": "77188d20-c02a-4816-acef-33d2b5800ec2"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:37:11.273678 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-055379a0-4346-432a-926a-aaf0fde30251 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:11.274218 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-055379a0-4346-432a-926a-aaf0fde30251 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:11.275277 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-055379a0-4346-432a-926a-aaf0fde30251 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:11.275802 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-055379a0-4346-432a-926a-aaf0fde30251 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:11.284921 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-7d68b9c4-63c7-4fe5-84b4-67c4d25aabd3 req-2641289c-1394-47da-9748-0b401168c753 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:11.285715 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-7d68b9c4-63c7-4fe5-84b4-67c4d25aabd3 req-2641289c-1394-47da-9748-0b401168c753 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:11.305469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-055379a0-4346-432a-926a-aaf0fde30251 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:37:11.308370 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-7d68b9c4-63c7-4fe5-84b4-67c4d25aabd3 req-2641289c-1394-47da-9748-0b401168c753 service nova] Creating event network-changed:77188d20-c02a-4816-acef-33d2b5800ec2 for instance 9ff53b5f-8422-468d-8c6c-48b571af4ab2 on hv-cinder-80475 May 19 12:37:11.318618 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-7d68b9c4-63c7-4fe5-84b4-67c4d25aabd3 req-2641289c-1394-47da-9748-0b401168c753 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057896 May 19 12:37:11.321083 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 619/1288] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:37:11.672385 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-055379a0-4346-432a-926a-aaf0fde30251 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 204 len: 0 microversion: 2.1 time: 0.412074 May 19 12:37:11.673359 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 670/1289] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:37:11 2022] DELETE /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:37:11.689696 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-9afc8166-87dd-4784-88a7-eca725682cd7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:11.692391 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-9afc8166-87dd-4784-88a7-eca725682cd7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:11.707069 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9afc8166-87dd-4784-88a7-eca725682cd7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:11.708903 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9afc8166-87dd-4784-88a7-eca725682cd7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:11.712550 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9afc8166-87dd-4784-88a7-eca725682cd7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:11.715274 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-9afc8166-87dd-4784-88a7-eca725682cd7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:11.920620 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.policy [None req-9afc8166-87dd-4784-88a7-eca725682cd7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117964) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:11.943201 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-9afc8166-87dd-4784-88a7-eca725682cd7 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1577 microversion: 2.1 time: 0.262783 May 19 12:37:11.947260 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 620/1290] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:37:11 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1577 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:12.962670 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-eba77ab9-fffa-4011-b223-89c5ad5a9812 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:12.963491 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-eba77ab9-fffa-4011-b223-89c5ad5a9812 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:12.971113 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eba77ab9-fffa-4011-b223-89c5ad5a9812 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:12.971674 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eba77ab9-fffa-4011-b223-89c5ad5a9812 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:12.972592 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eba77ab9-fffa-4011-b223-89c5ad5a9812 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:12.973115 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eba77ab9-fffa-4011-b223-89c5ad5a9812 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:13.135241 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-eba77ab9-fffa-4011-b223-89c5ad5a9812 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:13.144914 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-eba77ab9-fffa-4011-b223-89c5ad5a9812 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1459 microversion: 2.1 time: 0.187340 May 19 12:37:13.157094 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 671/1291] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:37:12 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1459 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:13.333345 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [req-f6598a21-1e4d-4dda-8b8f-f588b7cc1d86 req-d38ecb32-15fa-4585-a8ce-8c37ffc65d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ff53b5f-8422-468d-8c6c-48b571af4ab2", "name": "network-vif-deleted", "tag": "77188d20-c02a-4816-acef-33d2b5800ec2"}]} {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:37:13.343240 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-f6598a21-1e4d-4dda-8b8f-f588b7cc1d86 req-d38ecb32-15fa-4585-a8ce-8c37ffc65d95 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:13.343933 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [req-f6598a21-1e4d-4dda-8b8f-f588b7cc1d86 req-d38ecb32-15fa-4585-a8ce-8c37ffc65d95 service nova] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:13.356829 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.compute.server_external_events [req-f6598a21-1e4d-4dda-8b8f-f588b7cc1d86 req-d38ecb32-15fa-4585-a8ce-8c37ffc65d95 service nova] Creating event network-vif-deleted:77188d20-c02a-4816-acef-33d2b5800ec2 for instance 9ff53b5f-8422-468d-8c6c-48b571af4ab2 on hv-cinder-80475 May 19 12:37:13.361960 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [req-f6598a21-1e4d-4dda-8b8f-f588b7cc1d86 req-d38ecb32-15fa-4585-a8ce-8c37ffc65d95 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032339 May 19 12:37:13.362584 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 621/1292] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 19 12:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:37:14.167238 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-857a7ce0-77a8-48da-95db-f5acf2c48d69 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:14.167889 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-857a7ce0-77a8-48da-95db-f5acf2c48d69 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:14.175042 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-857a7ce0-77a8-48da-95db-f5acf2c48d69 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:14.175495 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-857a7ce0-77a8-48da-95db-f5acf2c48d69 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:14.176336 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-857a7ce0-77a8-48da-95db-f5acf2c48d69 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:14.176777 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-857a7ce0-77a8-48da-95db-f5acf2c48d69 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:14.215279 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-857a7ce0-77a8-48da-95db-f5acf2c48d69 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:14.215755 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-857a7ce0-77a8-48da-95db-f5acf2c48d69 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:14.216246 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-857a7ce0-77a8-48da-95db-f5acf2c48d69 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lazy-loading 'fault' on Instance uuid 9ff53b5f-8422-468d-8c6c-48b571af4ab2 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:37:14.286416 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-857a7ce0-77a8-48da-95db-f5acf2c48d69 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d158b01a0a74de4bc0131b5c625efdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b46044a7f1d471582800c9d8a79e5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:14.296226 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-857a7ce0-77a8-48da-95db-f5acf2c48d69 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 200 len: 1231 microversion: 2.1 time: 0.134155 May 19 12:37:14.296821 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 672/1293] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:37:14 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 1231 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:15.316495 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-fdb546d7-e195-4175-86d7-7b64faff3541 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:15.317700 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-fdb546d7-e195-4175-86d7-7b64faff3541 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: 9ff53b5f-8422-468d-8c6c-48b571af4ab2] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:15.325963 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fdb546d7-e195-4175-86d7-7b64faff3541 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:15.326538 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fdb546d7-e195-4175-86d7-7b64faff3541 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:15.327250 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fdb546d7-e195-4175-86d7-7b64faff3541 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:15.327683 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-fdb546d7-e195-4175-86d7-7b64faff3541 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:15.343203 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-fdb546d7-e195-4175-86d7-7b64faff3541 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] HTTP exception thrown: Instance 9ff53b5f-8422-468d-8c6c-48b571af4ab2 could not be found. May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-fdb546d7-e195-4175-86d7-7b64faff3541 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Request method failure captured: May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 HTTP/1.1 May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjeC2Em27PMp9Af2Y9rGUH2CGe7aXy_xBl2gaNgyc_fui5CRQJGgecuBicS5LhxjRGHyAdcG99UTAqjXcnhWRudO655qCHQ2_XKadQhcHqubtpN2Zh1FImipSVjvWb934hApgz0HundRUQITGibgYmIY7pTw3bDvFr9XflzI5ue9Sc4 May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 4b46044a7f1d471582800c9d8a79e5c5 May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-TestVolumeBootPattern-614865877 May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:37:15.345108 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:37:15.347728 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:37:15.347728 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-TestVolumeBootPattern-614865877 May 19 12:37:15.347728 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 4b46044a7f1d471582800c9d8a79e5c5 May 19 12:37:15.347728 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-TestVolumeBootPattern-614865877 May 19 12:37:15.347728 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-TestVolumeBootPattern-614865877-project May 19 12:37:15.347728 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:37:15.347728 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:37:15.347728 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: 2d158b01a0a74de4bc0131b5c625efdf May 19 12:37:15.347728 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-TestVolumeBootPattern-614865877-project May 19 12:37:15.347728 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:37:15.347728 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance 9ff53b5f-8422-468d-8c6c-48b571af4ab2 could not be found. May 19 12:37:15.347728 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': '9ff53b5f-8422-468d-8c6c-48b571af4ab2'} May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ff53b5f-8422-468d-8c6c-48b571af4ab2 could not be found. May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:37:15.349403 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:37:15.351957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:37:15.351957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:37:15.351957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:37:15.351957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:37:15.351957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:37:15.351957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:37:15.351957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:37:15.351957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ff53b5f-8422-468d-8c6c-48b571af4ab2 could not be found. May 19 12:37:15.351957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:37:15.351957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:15.351957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:37:15.351957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:15.351957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:15.351957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:15.351957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:37:15.351957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:37:15.351957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ff53b5f-8422-468d-8c6c-48b571af4ab2 could not be found. May 19 12:37:15.351957 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:37:15.356817 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-fdb546d7-e195-4175-86d7-7b64faff3541 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Returning 404 to user: Instance 9ff53b5f-8422-468d-8c6c-48b571af4ab2 could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:37:15.356817 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-fdb546d7-e195-4175-86d7-7b64faff3541 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2" status: 404 len: 111 microversion: 2.1 time: 0.035756 May 19 12:37:15.356817 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 622/1294] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:37:15 2022] GET /compute/v2.1/servers/9ff53b5f-8422-468d-8c6c-48b571af4ab2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:37:16.259196 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4b8ffad3-22bf-4463-92cc-a9d26f01aff5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:16.259906 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4b8ffad3-22bf-4463-92cc-a9d26f01aff5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:16.267062 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4b8ffad3-22bf-4463-92cc-a9d26f01aff5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:16.267516 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4b8ffad3-22bf-4463-92cc-a9d26f01aff5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:16.268345 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4b8ffad3-22bf-4463-92cc-a9d26f01aff5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:16.268787 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4b8ffad3-22bf-4463-92cc-a9d26f01aff5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:16.285664 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-4b8ffad3-22bf-4463-92cc-a9d26f01aff5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] HTTP exception thrown: Instance fd5e1226-df90-46cb-b63b-38a15848fa99 could not be found. May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4b8ffad3-22bf-4463-92cc-a9d26f01aff5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Request method failure captured: May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: request: DELETE /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 HTTP/1.1 May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept: application/json May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Connection: close May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Length: 0 May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Content-Type: application/json May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Host: 10.222.0.23 May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABihjeC2Em27PMp9Af2Y9rGUH2CGe7aXy_xBl2gaNgyc_fui5CRQJGgecuBicS5LhxjRGHyAdcG99UTAqjXcnhWRudO655qCHQ2_XKadQhcHqubtpN2Zh1FImipSVjvWb934hApgz0HundRUQITGibgYmIY7pTw3bDvFr9XflzI5ue9Sc4 May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Id: None May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Domain-Name: None May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Id: 4b46044a7f1d471582800c9d8a79e5c5 May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-TestVolumeBootPattern-614865877 May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Role: member,reader May 19 12:37:16.287617 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Roles: member,reader May 19 12:37:16.290732 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:37:16.290732 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-TestVolumeBootPattern-614865877 May 19 12:37:16.290732 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 4b46044a7f1d471582800c9d8a79e5c5 May 19 12:37:16.290732 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-TestVolumeBootPattern-614865877 May 19 12:37:16.290732 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User: tempest-TestVolumeBootPattern-614865877-project May 19 12:37:16.290732 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default May 19 12:37:16.290732 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default May 19 12:37:16.290732 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Id: 2d158b01a0a74de4bc0131b5c625efdf May 19 12:37:16.290732 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-TestVolumeBootPattern-614865877-project May 19 12:37:16.290732 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: method: > May 19 12:37:16.290732 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: exception: Instance fd5e1226-df90-46cb-b63b-38a15848fa99 could not be found. May 19 12:37:16.290732 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: action_args: {'id': 'fd5e1226-df90-46cb-b63b-38a15848fa99'} May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5e1226-df90-46cb-b63b-38a15848fa99 could not be found. May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:37:16.292469 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5e1226-df90-46cb-b63b-38a15848fa99 could not be found. May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5e1226-df90-46cb-b63b-38a15848fa99 could not be found. May 19 12:37:16.295064 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi May 19 12:37:16.298162 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4b8ffad3-22bf-4463-92cc-a9d26f01aff5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Returning 404 to user: Instance fd5e1226-df90-46cb-b63b-38a15848fa99 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:37:16.298162 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4b8ffad3-22bf-4463-92cc-a9d26f01aff5 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 404 len: 111 microversion: 2.1 time: 0.035559 May 19 12:37:16.298162 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 673/1295] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 19 12:37:16 2022] DELETE /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:37:16.301580 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-8c8208b7-896c-475c-83eb-3e12049790f0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '>' {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:16.302247 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.compute.api [None req-8c8208b7-896c-475c-83eb-3e12049790f0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] [instance: fd5e1226-df90-46cb-b63b-38a15848fa99] Fetching instance by UUID {{(pid=117964) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:16.310597 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8c8208b7-896c-475c-83eb-3e12049790f0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:16.311055 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8c8208b7-896c-475c-83eb-3e12049790f0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:16.311902 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8c8208b7-896c-475c-83eb-3e12049790f0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:16.312341 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG oslo_concurrency.lockutils [None req-8c8208b7-896c-475c-83eb-3e12049790f0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Lock "792a11ae-0eb2-4d8f-8039-aee2984c4d9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:16.328977 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.wsgi [None req-8c8208b7-896c-475c-83eb-3e12049790f0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] HTTP exception thrown: Instance fd5e1226-df90-46cb-b63b-38a15848fa99 could not be found. May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-8c8208b7-896c-475c-83eb-3e12049790f0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Request method failure captured: May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: request: GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 HTTP/1.1 May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept: application/json May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Accept-Encoding: identity May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Connection: close May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Length: 0 May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Content-Type: application/json May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Host: 10.222.0.23 May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Openstack-System-Scope: None May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: User-Agent: python-urllib3/1.26.9 May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Auth-Token: gAAAAABihjeC2Em27PMp9Af2Y9rGUH2CGe7aXy_xBl2gaNgyc_fui5CRQJGgecuBicS5LhxjRGHyAdcG99UTAqjXcnhWRudO655qCHQ2_XKadQhcHqubtpN2Zh1FImipSVjvWb934hApgz0HundRUQITGibgYmIY7pTw3bDvFr9XflzI5ue9Sc4 May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Id: None May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Domain-Name: None May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Identity-Status: Confirmed May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Is-Admin-Project: True May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Id: default May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Domain-Name: Default May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Id: 4b46044a7f1d471582800c9d8a79e5c5 May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Project-Name: tempest-TestVolumeBootPattern-614865877 May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Role: member,reader May 19 12:37:16.330578 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Roles: member,reader May 19 12:37:16.336665 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b46044a7f1d471582800c9d8a79e5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 19 12:37:16.336665 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant: tempest-TestVolumeBootPattern-614865877 May 19 12:37:16.336665 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Id: 4b46044a7f1d471582800c9d8a79e5c5 May 19 12:37:16.336665 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-Tenant-Name: tempest-TestVolumeBootPattern-614865877 May 19 12:37:16.336665 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User: tempest-TestVolumeBootPattern-614865877-project May 19 12:37:16.336665 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Id: default May 19 12:37:16.336665 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Domain-Name: Default May 19 12:37:16.336665 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Id: 2d158b01a0a74de4bc0131b5c625efdf May 19 12:37:16.336665 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: X-User-Name: tempest-TestVolumeBootPattern-614865877-project May 19 12:37:16.336665 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: method: > May 19 12:37:16.336665 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: exception: Instance fd5e1226-df90-46cb-b63b-38a15848fa99 could not be found. May 19 12:37:16.336665 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: action_args: {'id': 'fd5e1226-df90-46cb-b63b-38a15848fa99'} May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: {{(pid=117964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5e1226-df90-46cb-b63b-38a15848fa99 could not be found. May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:37:16.337672 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:37:16.339360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:37:16.339360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:37:16.339360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:37:16.339360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:37:16.339360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:37:16.339360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:37:16.339360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:37:16.339360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5e1226-df90-46cb-b63b-38a15848fa99 could not be found. May 19 12:37:16.339360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:37:16.339360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:16.339360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:37:16.339360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:16.339360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:16.339360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:16.339360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:37:16.339360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:37:16.339360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5e1226-df90-46cb-b63b-38a15848fa99 could not be found. May 19 12:37:16.339360 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: ERROR nova.api.openstack.wsgi May 19 12:37:16.340866 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: DEBUG nova.api.openstack.wsgi [None req-8c8208b7-896c-475c-83eb-3e12049790f0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Returning 404 to user: Instance fd5e1226-df90-46cb-b63b-38a15848fa99 could not be found. {{(pid=117964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:37:16.340866 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO nova.api.openstack.requestlog [None req-8c8208b7-896c-475c-83eb-3e12049790f0 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99" status: 404 len: 111 microversion: 2.1 time: 0.036104 May 19 12:37:16.340866 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: [pid: 117964|app: 0|req: 623/1296] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 19 12:37:16 2022] GET /compute/v2.1/servers/fd5e1226-df90-46cb-b63b-38a15848fa99 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:37:17.901973 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-92caa17d-91d7-4a85-b9b6-abed1a170378 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] Calling method '.version_select at 0x7f3ba293e8b0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:18.006074 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-92caa17d-91d7-4a85-b9b6-abed1a170378 tempest-TestVolumeBootPattern-614865877 tempest-TestVolumeBootPattern-614865877-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1269836910" status: 202 len: 0 microversion: 2.1 time: 0.113308 May 19 12:37:18.007141 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 674/1297] 10.222.0.23 () {58 vars in 1262 bytes} [Thu May 19 12:37:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1269836910 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:39:36.279147 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:39:36.280084 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Thu May 19 12:39:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:39:50.136151 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:39:50.136892 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Thu May 19 12:39:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:39:54.452486 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:39:54.453387 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Thu May 19 12:39:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:39:59.079057 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:39:59.079771 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Thu May 19 12:39:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:40:05.340545 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:40:05.341263 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Thu May 19 12:40:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:40:10.581123 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:40:10.581802 dv-cinder-804757-28-iscsi devstack@n-api.service[117963]: Thu May 19 12:40:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:42:56.289131 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:42:56.290029 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Thu May 19 12:42:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:43:10.145257 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:43:10.146562 dv-cinder-804757-28-iscsi devstack@n-api.service[117964]: Thu May 19 12:43:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!